Azure Databricks Discussions

.NET recently has brought notebook like interface support using dotnet interactive. It would be really great if we had direct inuilt support of them in Azure Databricks. No inbuilt support of .NET for Apache Spark of .NET Notebooks (dotnet-interactive). .NET recently has brought notebook like... Read more

I would like to use scikit learn more than MLlib because I am well trained in scikit and it's easy to implement than MLlib. So how do I use it along with Hadoop capabilities. I know we can simply import it but does mapreduce happen? If there is a way let people know how it could be done.

I want to connect azure databricks cluster with my IDE(jetbrains scala ide) because your notebook development environment is very time taking because of no intellisense and code management. how can I connect my azure databricks environment with IDE to right and run code

I am working with social networking data and some day I receive huge bulk data and someday data comes in size of mb. When data is less the speed is affected greatly.how to adjust configuration automatically to keep constant processing speed

As it is too costly

?

I dont want to use sparx