APC 技術ブログ

株式会社エーピーコミュニケーションズの技術ブログです。

株式会社 エーピーコミュニケーションズの技術ブログです。

2023-07-04から1日間の記事一覧

The Future of Data Management and Governance(データ管理とガバナンスの未来)

はじめに GLB事業部Lakehouse部のメイです。 現地でのData + AI SUMMIT2023(DAIS)に参加しているメンバーの報告をもとに、 データ管理とガバナンスの未来についての「The Future of Data Management and Governance」を共有します。 このセッションでは、L…

Embracing the Future of Data Engineering: The Serverless, Real-Time Lakehouse in Action(サーバーレスとストリーミングデータを活用したデータエンジニアリングの未来)

はじめに GLB事業部Lakehouse部のメイです。 現地でのData + AI SUMMIT2023(DAIS)に参加しているメンバーの報告をもとに、データエンジニアリングの未来を切り開くサーバーレス技術とストリーミングデータについての「Embracing the Future of Data Engine…

BackstageでGitHub リポジトリの状況を見る

Backstageの紹介 これまで何度かBackstageについてご紹介してきました。 techblog.ap-com.co.jp Backstageは簡単にいえば開発チーム向けのInternal Developer Portal(IDP)です。 Platform EngineeringにおいてもIDPを活用するのがよいということも言われて…

Fine Tuning and Scaling Hugging Face with Ray AIR

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Gibo, who is participating in Data + AI SUMMIT2023 (DAIS) on site. Art…

Data Biases and Generative AI: A Practitioner Discussion

Introduction This is May from the GLB Division Lakehouse Department. We will share "Data Biases and Generative AI: A Practitioner Discussion" on data biases and generative AI based on reports from members participating in the local Data + …

The Best Data Warehouse is a Lakehouse: How Databricks Achieves Operational Efficiency With the Lakehouse Architecture

Introduction This is May from the GLB Division Lakehouse Department. Based on reports from members participating in the local Data + AI SUMMIT 2023 (DAIS), a new architecture that combines a data warehouse and a data lake, "The Best Data W…

Learn How to Reliably Monitor Your Data and Model Quality in the Lakehouse

Introduction This Chen from GLB Business Department Lakehouse Department. I watched the Data + AI SUMMIT2023 (DAIS) webcast session "Learn How to Reliably Monitor Your Data and Model Quality in the Lakehouse". I will tell you the contents …

Lakehouses: The Best Start to Your Graph Data and Analytics Journey

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Ichimura participating in Data + AI SUMMIT2023 (DAIS). Articles about the sessi…

How to Build LLMs on Your Company’s Data While on a Budget

I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in Data + AI SUMMIT 2023 (DAIS2023) held in San Francisco, "How to Build LLMs on Your Company's Data While on a Budget" Her…

Data Application Bundles: A Standard, Unified Approach to Deploying Data Products on Databricks

Introduction This is May from the GLB Division Lakehouse Department. We will share "Data Application Bundles: A Standard, Unified Approach to Deploying Data Products on Databricks" based on reports from members participating in the local D…

Best Practices for Running Efficient Apache Spark™ Workloads on Databricks

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Gibo who is participating in Data + AI SUMMIT2023 (DAIS2023) held in San Francisco, "Best Practices for Running Efficient Apache Spark™ Workl…

What’s New in Databricks Workflows -- With Live Demos

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the content of the session based on reports from Mr. Ichimura participating in Data + AI SUMMIT2023 (DAIS). Articles about t…

Streaming Schema Drift Discovery and Controlled Mitigation

Introduction This is Abe from the Lakehouse Department of the GLB Division. I wrote an article summarizing the content of the session based on the report by Mr. Gibo, who is participating in Data + AI SUMMIT2023 (DAIS) on site. Articles ab…

LLMOps: Everything You Need to Know to Manage LLMs

Introduction This is May from the GLB Division Lakehouse Department. Based on reports from members participating in the local Data + AI SUMMIT 2023 (DAIS), Share "LLMOps: Everything You Need to Know to Manage LLMs". This session was conduc…

Data Caching Strategies for Data Analytics and AI

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I wrote an article summarizing the contents of the session based on the report by Mr. Nagae, who is participating in Data + AI SUMMIT2023 (DAIS) on site. A…

What's New in Databricks SQL -- With Live Demos

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato who is participating in Data + AI SUMMIT 2023 (DAIS2023) held in San Francisco, "What's New in Databricks SQL -- With Live Demos" I …

Accelerating the Development of Viewership Personas with a Unified Feature Store

I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in Data + AI SUMMIT 2023 (DAIS2023) held in San Francisco, he will discuss the theme of "Accelerating the Development of Vi…

Fine Tuning and Scaling Hugging Face with Ray AIR(Ray AIR を用いたHugging Faceの微調整とスケーリング)

はじめに GLB事業部Global Engineering部 佐々木です。 現地でのData + AI SUMMIT2023(DAIS)に参加している儀保の報告をもとに、セッションの内容をまとめた記事を書きました。 DAISでのセッションに関する記事は、以下の特設サイトにまとめています。 htt…

What’s New with Data Sharing and Collaboration on the Lakehouse: From Delta Sharing to Clean Rooms

I'm Chen from the Lakehouse Department of the GLB Division. Based on reports from cities and villages participating in Data + AI SUMMIT2023 (DAIS2023) held in San Francisco, "What's New with Data Sharing and Collaboration on the Lakehouse:…

Unlocking the Value of Data Sharing in Financial Services with Lakehouse

Introduction This is May from the GLB Division Lakehouse Department. "Unlocking the Value of Data Sharing in Financial Services with Lakehouse”. This session, by Spencer Cook, Senior Solutions Architect at Databricks, discusses how to maxi…

Testing Generative AI Models: What You Need to Know

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Nagae, who is attending Data + AI SUMMIT2023 (DAIS2023) in San Francisco, I wrote a paper titled "Testing Generative AI Models: What You Need to …

dbt Labs | Leveling Up SQL Transformations in the Lakehouse with dbt

Introduction I'm Chen from the Lakehouse Department of the GLB Division. Based on a report by Mr. Nagasato, who is participating in the Data + AI SUMMIT 2023 (DAIS) held in San Francisco, "dbt Labs | Leveling Up SQL Transformations in the …

Delta Live Tables A to Z: Best Practices for Modern Data Pipelines Part 2

Introduction I'm Sasaki from the Global Engineering Department of the GLB Division. I participated in the local Data + AI SUMMIT2023 (DAIS) and wrote an article summarizing the content of the session. Articles about the session at DAIS are…