I'm Chen from the Lakehouse Department of the GLB Division. Based on reports from cities and villages participating in Data + AI SUMMIT2023 (DAIS2023) held in San Francisco, "What's New with Data Sharing and Collaboration on the Lakehouse: From Delta Sharing to Clean Rooms The latest in data sharing and collaboration: From delta sharing to clean rooms” is an overview of the session.
This session was presented by Databricks' Erika Ehrli, Xiaotong Sun, and Kelly Albano. The theme aims to simplify the lives of its customers by simplifying the process of data sharing and collaboration. The target audience is business people interested in data sharing and collaboration, engineers interested in data analysis and AI, and companies feeling limited by cloud and platform options.
Data sharing and collaboration challenges and solutions
Data sharing and collaboration are key factors in helping companies stay competitive and drive innovation. However, these processes are often complex, making efficient data utilization difficult. We will discuss the challenges and solutions of data sharing and collaboration, the importance of security and governance, and an overview of delta sharing, cleanrooms, and marketplaces.
Importance of security and governance
Security and governance are important considerations to simplify the process of data sharing and collaboration. It is essential to identify platform issues, evolve layouts and the Databricks platform, and help customers solve these issues. It is also important to use open protocols to share all data, including AI, to share machine learning models, notebooks, dashboards, etc. Additionally, it is important that the platform provides sufficient support for secure and well-governed solution sharing with Unity Carabao and Delta sharing.
Introducing Delta Sharing and Clean Rooms
Delta Sharing and Clean Rooms were introduced as the latest trends in data sharing and collaboration. These technologies aim to further simplify the process of data sharing and simplify the lives of our customers.
- Delta Sharing: A data sharing function based on an open protocol that facilitates the exchange of data between different platforms
- Clean Rooms: Provides an environment that can be used for data analysis and marketing activities while protecting data privacy
With the introduction of these technologies, Databricks Lakehouse is expected to bring further innovation in the area of data sharing and collaboration.
Summary
In this talk, we discussed data sharing and collaboration challenges and solutions, the importance of security and governance, and the introduction of Delta Sharing and Clean Rooms. By leveraging these technologies, companies can streamline data sharing and collaboration processes and maximize the value of external data. Data sharing and collaboration technologies will continue to evolve.
Conclusion
This content based on reports from members on site participating in DAIS sessions. During the DAIS period, articles related to the sessions will be posted on the special site below, so please take a look.
Translated by Johann
Thank you for your continued support!
