Lyric discussion by ifif 

Cover art for Aiko lyrics by Emmy the Great

Yes, that part is in Cantonese and the first bit actually means something like 'I don't really speak Japanese'!

And then something like 'but I will always love you'. Aww.

I think the 'Or sayee' is part of the girl's name - Aiko Osai or something like that.