Why does this use いえ instead of うち? It doesn’t seem like it’s saying “the people in this physical location” but rather “the people of my household”…?
俺のいえ is kinda like “in my household” while 俺のうち is like “in my home”.
いえ is more for family traits, culture, etc. while うち is more everyday life.
俺のいえ - people in my family are tall, there are a lot of doctors in my family, in my family we don’t talk about money
俺のうち - we don’t have a TV in my house, at my house we have a dog
Consider how another meaning for うち is “inside”, so it’s like the perspective from inside.
“Oh yea, in my house we don’t have a TV. That’s my Mom’s rule” - perspective from inside
“In my house a lot of people work in sports.” - there’s not really an opinion there, it’s just a neutral fact
Thank you! Do you happen to have any source that states that?
Everything I’ve found online says いえ is specifically for the building and nothing more while うち is for home, household, family traits, etc while also possibly able to be used for the building which confuses me.
I appreciate your help!
Honestly I’m not sure if the difference is that strict, because everything I’ve looked at has said they both mean pretty much the same thing. 
This Wikipedia article says いえ “can mean either a physical home or refer to a family’s lineage.”
My guess in this context (just a guess) is that the sentence doesn’t mean “In my house there are a lot of people who work in sports (me, my dad, my mom, etc)”.
It means “In my family a lot of people work in sports” (my dad, my grandfather, my great aunt who doesn’t live with us). So it’s いえ in the sense of “my family lineage works in sports/we are a sports industry family” and not “the people who live in the same うち as me.”
Thank you!