openmailbox / rodimus Goto Github PK

I'm not an ETL expert, so please read this with that in mind :)

The use case I'm looking at is:

• pull some data from an API
• parse the response into JSON
• manipulate the data so its a different JSON structure
• save the data into a collection CSV files

I understand the IO based design of Rodimus, but wondering if you've encountered a situation where it would make more sense to pass objects or hashes around rather than needing to convert to streamable data. Or is there a pattern how this might be done with Rodimus currently? It feels like every step needs to do conversions between strings and JSON.

Note: the data is small so performance is not an issue, and converting is only a couple of lines, I'm more just interested in if this was ever a consideration.

Much appreciate any comments!

Hi, I'm really interested to try out Rodimus, but my use case is one where I need to output multiple CSV files. Can you suggest if this is a good fit for Rodimus, and what the best approach might be?