addresses, phones, emails makes for possibly three portals. (I tend to combine phone numbers and email addresses in the same table and portal, but that's not a big detail.
3 portals per contact on your layout doesn't seem like two big of an issue unless you have some pretty complicated portal filters and conditional formats involved.
In one of my layouts, I have a list of 20 odd records with about that many filtered portals (and with conditionally formatted text in each) all viewed via List View. No "acting funny" issues, but is slower to redraw the screen than I prefer.