How is Nifi? I've seen it pass by at work, as a generic ingestion application, but for most ingestions we're using custom-written Python for better flexibility.

I've never worked with it, but it looked pretty daunting (as an initial view).