Not only do you need capped fame to even get the quest all 5 people coming with you will as well. You will also need to be 60+ to even think about completing any of these quests. Oh, you will need this at each city that has a avatar as well... not just one.
I recommend checking the "quests" section of the website if you want to bother with it. Personally the class to me has been nothing but "ooohhh" "ahhhh" but no real substance. The pets in combat seem very poor and about the only useful features are the buffs they can give then you put them away.
I plan to just play the class as a sub for my whm for mp and regen. I think you'll get more bang for your mp out of healing than summoning but thats just my experience. Wait for them to "tweak" the class.
It's insanely difficult for something barely, if at all, worth it. Unless of course you like to look cool with Ifrit hanging on your shoulder.