APC 技術ブログ

株式会社エーピーコミュニケーションズの技術ブログです。

株式会社 エーピーコミュニケーションズの技術ブログです。

Unlocking the Value of Data Sharing in Financial Services with Lakehouse

Introduction This is May from the GLB Division Lakehouse Department. "Unlocking the Value of Data Sharing in Financial Services with Lakehouse”. This session, by Spencer Cook, Senior Solutions Architect at Databricks, discusses how to maxi…

Testing Generative AI Models: What You Need to Know

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Nagae, who is attending Data + AI SUMMIT2023 (DAIS2023) in San Francisco, I wrote a paper titled "Testing Generative AI Models: What You Need to …

dbt Labs | Leveling Up SQL Transformations in the Lakehouse with dbt

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in the Data + AI SUMMIT 2023 (DAIS) held in San Francisco, "dbt Labs | Leveling Up SQL Transformations in the …

Delta Live Tables A to Z: Best Practices for Modern Data Pipelines Part 2

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I participated in the local Data + AI SUMMIT2023 (DAIS) and wrote an article summarizing the content of the session. Articles about the session at DAIS are…

Generative AI Fundamentals

Introduction ​ GLB Business Department Lakehouse Department Chen. Based on the report by Mr. Nagasato who participated in Data + AI SUMMIT 2023 (DAIS) on site, I would like to introduce the session "Generative AI Fundamentals". This sessio…

How to Build a Metadata Driven Data Pipelines with Delta Live Tables

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Ichimura who participated in Data + AI SUMMIT2023 (DAIS) on site. This time, I…

Databricks Cost Management: Tips and Tools to Stay Under Budget

Introduction I'm Chen from Lakehouse Department, GLB Business Department. "Databricks Cost Management: Tips and Tools to Stay Under Budget" based on a report by Mr. Kanamaru who participated in the local Data + AI SUMMIT 2023 (DAIS) Here i…

Databricks SQL Serverless Under the Hood: How We Use ML to Get the Best Price/Performance

Introduction This is Abe from the Lake House Department of the GLB Division. I wrote an article summarizing the contents of the session of Data + AI SUMMIT2023 (DAIS) that I participated in virtually. I would like to talk about the Databri…

Databricks Marketplace: Going Beyond Data and Applications

Introduction This is May from the GLB Division Lakehouse Department. Based on the reports of members participating in the local Data + AI SUMMIT 2023 (DAIS), the Databricks Marketplace Share "Databricks Marketplace: Going Beyond Data and A…

Factory of the Future: Case Study of Building Digital Twins Using Knowledge Graphs and Generative AI

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Kanamaru, who is participating in Data + AI SUMMIT 2023 (DAIS) on site…

Experience the New Era of Data & AI: Taking Bold Steps - 02

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Ichimura who participated in Data + AI SUMMIT2023 (DAIS) on site. This time, we're…

Experience the New Era of Data & AI: Taking Bold Steps - 01

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Ichimura who participated in Data + AI SUMMIT2023 (DAIS) on site. Hello! This time…

How the Texas Rangers Revolutionized Baseball Analytics with a Modern Data Lakehouse

Introduction This is May from the GLB Division Lakehouse Department. We share "How the Texas Rangers Revolutionized Baseball Analytics with a Modern Data Lakehouse" based on reports from members attending the local Data + AI SUMMIT2023 (DA…

Anomalo | Data Archaeology: How to Quickly Understand an (Unfamiliar) Dataset Using Machine Learning

Introduction This is Abe from the Lakehouse Department of the GLB Division. Based on the report by Mr. Nagasato who participated in Data + AI SUMMIT 2023 (DAIS) on site, I wrote an article summarizing the content of the session. This time,…

Advancements in Open Source LLM Tooling, Including MLflow

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the contents of the session based on the report by Mr. Nagasato, who is participating in Data + AI SUMMIT 2023 (DAIS) on sit…

Jet Streaming Data and Predictive Analytics

Introduction This is May from the Lake House Department of the GLB Division. "Jet Streaming Data and Predictive Analytics: How the Lakehouse and Apache Spark "™ Enable Collins Aerospace to Keep Aircraft Flying" Lakehouse and Apache Spark™ …

De-Risking Language Models for Faster Adoption

Learning the Importance of AI Auditing and Risk Management: A Report on a Fascinating Lecture ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on re…

De-Risking Language Models for Faster Adoption (言語モデルのリスクを軽減してより迅速な導入を実現)

AI監査とリスク管理の重要性を学ぶ講演をレポート ​GLB事業部Global Engineering部 ヨハンです。 現地でのData + AI SUMMIT2023(DAIS)に参加している市村の報告をもとに、セッションの内容をまとめた記事を書きました。​ ​ 今回は、AI技術に関心がある方や…

A Fireside Chat: Building Your Startup on Databricks

Boosting Data Analytics Capabilities for Startups through Partnership with Databricks ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports fr…

A Fireside Chat: Building Your Startup on Databricks (囲炉裏チャット: Databricks でスタートアップを構築する)

Databricksとのパートナーシップでデータ分析能力を向上させるスタートアップ企業 GLB事業部Global Engineering部 ヨハンです。 現地でのData + AI SUMMIT2023(DAIS)に参加している永里の報告をもとに、セッションの内容をまとめた記事を書きました。​ ​ …

Comparing Databricks and Snowflake for Machine Learning

Introduction ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Gibo participating in Data + AI SUMMIT2023 (DAIS).​ ​ In this post…

Comparing Databricks and Snowflake for Machine Learning (機械学習における Databricks と Snowflake の比較)

はじめに ​GLB事業部Global Engineering部 ヨハンです。 現地でのData + AI SUMMIT2023(DAIS)に参加している儀保の報告をもとに、セッションの内容をまとめた記事を書きました。​ ​ 今回は、最近視聴した講演「Comparing Databricks and Snowflake for Mac…

Getting Insight From Anything: Gathering Data With IoT Devices and Delta Live

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Ichimura, who is participating in Data + AI SUMMIT 2023 (DAIS) held in San Francisco, he published the title "Getting Insight From Anything: Gath…

Why a Major Japanese Financial Institution Chose Databricks to Accelerate its Data and AI-Driven Journey

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the contents of the session based on the report by Mr. Nagae, who is participating in Data + AI SUMMIT2023 (DAIS) on site. Articles …

Making Travel More Accessible for Customers Bringing Mobility Devices

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Kanamaru, who is participating in Data + AI SUMMIT 2023 (DAIS) on site. Articl…

Scaling Deep Learning Using Delta Lake Storage Format on Databricks

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the contents of the session based on the report by Mr. Nagae, who is participating in Data + AI SUMMIT2023 (DAIS) on site. A…

DATA+AI Summit 2023 EXPO!! (Contributed by Databricks)

Introduction This is Ichimura from the lakehouse department of the glb business department. I am participating in the "Data + AI SUMMIT 2023 (DAIS)" being held in San Francisco from June 26, 2023, and I feel the explosive excitement at the…

Increasing Trust in Your Data: Enabling a Data Governance Program on Databricks Using Unity Catalog and ML-Driven MDM Part 2/2

Introduction ​This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Ichimura participating in Data + AI SUMMIT2023 (DAIS).​ ​ In this …

Increasing Trust in Your Data: Enabling a Data Governance Program on Databricks Using Unity Catalog and ML-Driven MDM Part 2/2 (データの信頼性の向上: Unity Catalog と ML ドリブン MDM を使用した Databricks でのデータ ガバナンス プログラムの有効化 Part 2/2)

はじめに ​GLB事業部Global Engineering部 ヨハンです。 現地でのData + AI SUMMIT2023(DAIS)に参加している市村の報告をもとに、セッションの内容をまとめた記事を書きました。​ ​ 今回は、データガバナンスプログラムを実現するための取り組みについて紹…

Increasing Trust in Your Data: Enabling a Data Governance Program on Databricks Using Unity Catalog and ML-Driven MDM Part 1/2

Introduction This is Johann from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Ichimura participating in Data + AI SUMMIT2023 (DAIS).​ ​ In this p…