Plundering Vs. Attacking a Manor

I was playing with this a little today.

Plundering a Manor
No wall, just the troops.
Even though the scout showed 300K Wood, Stone, and Iron, I received less than 1K of each. (Seems I got ripped off)

Attacking a Manor
Wall is there.
Didn't attack because I didn't feel like taking a loss to the wall that can reach and take out thousands of troops no matter where they are.
Do you get more resources from a manor if you attack is vs plunder it? Is it worth it?

Plunder = outer-city resources

Attack = both outer and inner-city resources

You got very little resources when plundering, so what do you think about the "worth" of using Attack? I would say it depends on your losses to get the rest of it, no?