Startup Idea: Data Processing & Statistical Modeling Software
Summary for idea #1496
Startup idea to develop a software capable of processing large datasets, performing statistical modeling, and enabling user-customized code for model estimation. The software should combine the flexibility of Python or R with the data processing capabilities of Spark.
Original submission by someone willing to pay to get a problem solved (not AI)
I am a data scientist at a large bank.
One of the main paint points is that there is no software that is capable of processing large datasets, performing statistical modeling, and allowing for flexible user provided code to estimate customized models. For example, SAS is not flexible, Python has memory constraints, and Spark has poor modeling capabilities.
An ideal software would have flexibility of Python or R but the data processing capabilities of Spark.
My company would certainly pay for this. I have tried. I solve the problem by utilizing multiple softwares in the same project.
Access over 4k more startup ideas
(Instant, free access. No CC required.)