First, condolences on the loss of your brother. May his memory be for a blessing.
Your question is clearly time-bound so I will answer it as quickly as possible. In a short answer, yes, you may bring the food to your own home.
The tradition of bringing food to shiva is rabbinic. It is the 'Meal of Consolation' or the 'Meal of Condolence' and is practiced by every Jewish community (and, I suspect, every non-Jewish community, as well). Bringing food is a natural (and, I believe, instinctive) reaction to show sympathy. It is not surprising, then, that such a tradition became de rigueur in Jewish life.
The tradition of bringing food is that the food is brought to the mourner, not to the mourner's house. And, since the food was brought to you and your family at a shiva house, then it is logical that, should you move to another place to sit shiva, you certainly may take the food. Of couse, if anyone else is sitting shiva in that house, the food must also be available for them, as well.
_____
In addition, I would like to add the following thought. I attend many shiva homes, family celebrations, etc., and I am constantly amazed at the waste of food. Should there be food left over from the function, I believe the concept of 'al tashchit' - do not destroy - can apply. In other words, don't destroy something valuable when it can still be used. Although it is customarily applied to things like flora and fauna, we can also apply it to food. If there is food from shiva left over, is there any place you can donate it to? Are there any needy people in your world that could use the food? Though giving what's left of the shiva food to the needful has no textual basis (as far as I have come across), it may be a beautiful way to honor your brother's memory.
______
May his soul be bound up in the bonds of eternal life and may his memory be for a blessing.
Answered by: Rabbi Cy Stanway