Indirect tax (VAT) in Banking industry issue

Hello, Everyone.
I do need your help to give me the following information as I will have an interview for the role of VAT/indirect tax in bank which I have never involved in and I am not a specialist for VAT either.
Could you tell me some examples why they still have VAT taxable supplies as they normally are exempted due to financial services?
What VAT aspects or VAT treatment do banking industries have? Are there any specail VAT rules especially for VAT in banking industries?
Are there any VAT( recent)issues in particularly banking industry I should know about ?
Thank you very much for your time and kind assistnace in advance.