Yep, that was the plan. Worked for a while really well til YASD.
Check out RoF on duelist! Just like everyone else, having a weapon equipped makes RoF a way worse bonus than going unarmed. There isn't a special RoF attack either.
But, the duelist has a whole extra mechanic called Brawler's Stance. You can be in it always. While in it, you do RoF damage but can use weapon abilities and proc enchantments. However, your weapon ability recharges at half speed.
I also came across a Horn of Plenty, so at any time I could snack from it to increase my charges by 1 (first T2 talent iirc). Worked great.