I think the song is about fishing - but about fishing as a metaphor for either picking up women (who are the "fish") or running some sort of con (in which case the singers victims are the "fish"). Both interpretations work to some degree (though "throw back" and "pan fry" sound more like what you'd do to a con victim). Anyway the singer goes into some neighborhood where he doesn't belong to try his exploits.
I think the song is about fishing - but about fishing as a metaphor for either picking up women (who are the "fish") or running some sort of con (in which case the singers victims are the "fish"). Both interpretations work to some degree (though "throw back" and "pan fry" sound more like what you'd do to a con victim). Anyway the singer goes into some neighborhood where he doesn't belong to try his exploits.