packaging
Install Python Packages on Azure Synapse
This post will be very similar to the last one. But this time, we’ll release our python package to Azure Synapse instead of Databricks. In order to unit test Synapse Notebooks, you’ll have to jump through all sorts of hoops.
Install Python Packages on Databricks
Let’s use the same basic setup as in test python code, then use our knowledge from create python packages to convert our code to a package. And finally we will install the package on our Databricks cluster.
Enhance Your Databricks Workflow
With databricks-connect you can connect your favorite IDE to your Databricks cluster. This means that you can now lint, test, and package the code that you want to run on Databricks more easily:
Create Python Packages
Why should you care about creating packages? Packages are easy to install (pip install demo). Packages simplify development (pip install -e . installs your package and keeps it up-to-date during development). Packages are easy to run and test …
