APC 技術ブログ

株式会社エーピーコミュニケーションズの技術ブログです。

株式会社 エーピーコミュニケーションズの技術ブログです。

Databricks_EN

Lakehouses: The Best Start to Your Graph Data and Analytics Journey

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Ichimura participating in Data + AI SUMMIT2023 (DAIS). Articles about the sessi…

How to Build LLMs on Your Company’s Data While on a Budget

I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in Data + AI SUMMIT 2023 (DAIS2023) held in San Francisco, "How to Build LLMs on Your Company's Data While on a Budget" Her…

Data Application Bundles: A Standard, Unified Approach to Deploying Data Products on Databricks

Introduction This is May from the GLB Division Lakehouse Department. We will share "Data Application Bundles: A Standard, Unified Approach to Deploying Data Products on Databricks" based on reports from members participating in the local D…

Best Practices for Running Efficient Apache Spark™ Workloads on Databricks

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Gibo who is participating in Data + AI SUMMIT2023 (DAIS2023) held in San Francisco, "Best Practices for Running Efficient Apache Spark™ Workl…

What’s New in Databricks Workflows -- With Live Demos

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Ichimura participating in Data + AI SUMMIT2023 (DAIS). Articles about t…

Streaming Schema Drift Discovery and Controlled Mitigation

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Gibo, who is participating in Data + AI SUMMIT2023 (DAIS) on site. Articles ab…

LLMOps: Everything You Need to Know to Manage LLMs

Introduction This is May from the GLB Division Lakehouse Department. Based on reports from members participating in the local Data + AI SUMMIT 2023 (DAIS), Share "LLMOps: Everything You Need to Know to Manage LLMs". This session was conduc…

Data Caching Strategies for Data Analytics and AI

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the contents of the session based on the report by Mr. Nagae, who is participating in Data + AI SUMMIT2023 (DAIS) on site. A…

What's New in Databricks SQL -- With Live Demos

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato who is participating in Data + AI SUMMIT 2023 (DAIS2023) held in San Francisco, "What's New in Databricks SQL -- With Live Demos" I …

Accelerating the Development of Viewership Personas with a Unified Feature Store

I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in Data + AI SUMMIT 2023 (DAIS2023) held in San Francisco, he will discuss the theme of "Accelerating the Development of Vi…

What’s New with Data Sharing and Collaboration on the Lakehouse: From Delta Sharing to Clean Rooms

I'm Chen from the Lakehouse Department of the GLB Division. Based on reports from cities and villages participating in Data + AI SUMMIT2023 (DAIS2023) held in San Francisco, "What's New with Data Sharing and Collaboration on the Lakehouse:…

Unlocking the Value of Data Sharing in Financial Services with Lakehouse

Introduction This is May from the GLB Division Lakehouse Department. "Unlocking the Value of Data Sharing in Financial Services with Lakehouse”. This session, by Spencer Cook, Senior Solutions Architect at Databricks, discusses how to maxi…

Testing Generative AI Models: What You Need to Know

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Nagae, who is attending Data + AI SUMMIT2023 (DAIS2023) in San Francisco, I wrote a paper titled "Testing Generative AI Models: What You Need to …

dbt Labs | Leveling Up SQL Transformations in the Lakehouse with dbt

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in the Data + AI SUMMIT 2023 (DAIS) held in San Francisco, "dbt Labs | Leveling Up SQL Transformations in the …

Delta Live Tables A to Z: Best Practices for Modern Data Pipelines Part 2

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I participated in the local Data + AI SUMMIT2023 (DAIS) and wrote an article summarizing the content of the session. Articles about the session at DAIS are…

Generative AI Fundamentals

Introduction ​ GLB Business Department Lakehouse Department Chen. Based on the report by Mr. Nagasato who participated in Data + AI SUMMIT 2023 (DAIS) on site, I would like to introduce the session "Generative AI Fundamentals". This sessio…

How to Build a Metadata Driven Data Pipelines with Delta Live Tables

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Ichimura who participated in Data + AI SUMMIT2023 (DAIS) on site. This time, I…

Databricks Cost Management: Tips and Tools to Stay Under Budget

Introduction I'm Chen from Lakehouse Department, GLB Business Department. "Databricks Cost Management: Tips and Tools to Stay Under Budget" based on a report by Mr. Kanamaru who participated in the local Data + AI SUMMIT 2023 (DAIS) Here i…

Databricks SQL Serverless Under the Hood: How We Use ML to Get the Best Price/Performance

Introduction This is Abe from the Lake House Department of the GLB Division. I wrote an article summarizing the contents of the session of Data + AI SUMMIT2023 (DAIS) that I participated in virtually. I would like to talk about the Databri…

Databricks Marketplace: Going Beyond Data and Applications

Introduction This is May from the GLB Division Lakehouse Department. Based on the reports of members participating in the local Data + AI SUMMIT 2023 (DAIS), the Databricks Marketplace Share "Databricks Marketplace: Going Beyond Data and A…

Factory of the Future: Case Study of Building Digital Twins Using Knowledge Graphs and Generative AI

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Kanamaru, who is participating in Data + AI SUMMIT 2023 (DAIS) on site…

Experience the New Era of Data & AI: Taking Bold Steps - 02

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Ichimura who participated in Data + AI SUMMIT2023 (DAIS) on site. This time, we're…

Experience the New Era of Data & AI: Taking Bold Steps - 01

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Ichimura who participated in Data + AI SUMMIT2023 (DAIS) on site. Hello! This time…

How the Texas Rangers Revolutionized Baseball Analytics with a Modern Data Lakehouse

Introduction This is May from the GLB Division Lakehouse Department. We share "How the Texas Rangers Revolutionized Baseball Analytics with a Modern Data Lakehouse" based on reports from members attending the local Data + AI SUMMIT2023 (DA…

Anomalo | Data Archaeology: How to Quickly Understand an (Unfamiliar) Dataset Using Machine Learning

Introduction This is Abe from the Lakehouse Department of the GLB Division. Based on the report by Mr. Nagasato who participated in Data + AI SUMMIT 2023 (DAIS) on site, I wrote an article summarizing the content of the session. This time,…

Advancements in Open Source LLM Tooling, Including MLflow

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the contents of the session based on the report by Mr. Nagasato, who is participating in Data + AI SUMMIT 2023 (DAIS) on sit…

Jet Streaming Data and Predictive Analytics

Introduction This is May from the Lake House Department of the GLB Division. "Jet Streaming Data and Predictive Analytics: How the Lakehouse and Apache Spark "™ Enable Collins Aerospace to Keep Aircraft Flying" Lakehouse and Apache Spark™ …

De-Risking Language Models for Faster Adoption

Learning the Importance of AI Auditing and Risk Management: A Report on a Fascinating Lecture ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on re…

A Fireside Chat: Building Your Startup on Databricks

Boosting Data Analytics Capabilities for Startups through Partnership with Databricks ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports fr…

Comparing Databricks and Snowflake for Machine Learning

Introduction ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Gibo participating in Data + AI SUMMIT2023 (DAIS).​ ​ In this post…