So a month ago, I asked a question to this and other subreddits
How many of you deal with multiple platforms or tools on day to day basis and got some really good insights, it was a resounding yes for a lot of engineers. Conclusion was that it's just how orgs set up things and we adapted it as standards.
Started looking into what solutions exists today and what else could be better to solve this.
What exists today,
- integration through MCP server but this is an technical overhead and lot of dara an md BI engineers would shy away and organization would have their own reservations on MCP setup
- frontier models computer use ( it's a hit or miss if you want interact with platforms like databricks or jira etc and token maxing will get vp or directors attentions )
What else can exist:
An tool that is custom built for Data and BI engineers.
- one that lives next to where you work be it databricks , snowflake , duckdb , metabase etc
- one that does not require MCP server set up
- one that makes you stop visiting adjacent tool/platform for updating like jira progress , dropping a note on teams or slack, reading a message from relevant people from teams or slack, synching code to your repository etc
- one that brings context from adjacent tools for you to review and start your day from there..
- one that codes in UI after your review and approve
- one that attempts to understand all types of inputs excel, CSV , word , images , architecture diagram , kickoff meeting video etc
- one that does not need you to learn another tool
- one that makes every data pipeline remember why and how, it exists by keeping tribal knowledge of developement intact and available for next engineers who inherit
Essentially an AI literally attached to your browser brings context from different platform or tools you have opened and assist you with whatever is needed during development and lives with the pipeline forever.
Looking for feedback
- What limitation do you foresee
- Whats one thing you would hate about it
- Whats one thing that could make you say yeah that works for me
- What assumption from the above is wrong or right
Let me know your thoughts
Any feedback back is much appreciated