There are some ways to make it work with OTR, but realistically speaking no.

Personally I get around that by using XMPP and connecting to IRC via the excellent Biboumi gateway. Thus I get the best of both, as XMPP is working really well for e2ee 1:1 chats.