Get yourself a cheap-ass Android phone and use that as a secondary device only when you need to use your bank. Otherwise, it can remain powered off at all times.