APC 技術ブログ

株式会社エーピーコミュニケーションズの技術ブログです。

株式会社 エーピーコミュニケーションズの技術ブログです。

How to connect Databricks and KX: PyKX with kdb Insights license

Introduction I am Jung from the GLB Business Unit, Lakehouse Section. In this article, I will introduce how to use KX's PyKX to connect Databricks and KX. We will perform verification using kdb Insights license of KX's product kdb+ on Data…

Introduction to KDB.AI (7) - Sample code (Sentiment Analysis)

Introduction This is May from the Lakehouse Department of the GLB Division. KX Systems leveraged the time series database kdb+ to release KDB.AI in September 2023. KDB.AI is a powerful knowledge-based vector database and search engine that…

Introduction to KDB.AI (6) - Sample code (Image Search)

Introduction This is Abe from the Lakehouse Department of the GLB Division. In this article, we will introduce a method to search for images similar to head MRI images using KDB.AI. KDB.AI is a knowledge base vector database and search eng…

Introduction to KDB.AI (5) - Sample code (LangChain and RAG)

Introduction This is Jung from the Lakehouse Department of the GLB Division. In this article, I would like to introduce the sample code practice of KDB.AI that I introduced in the previous article. KDB.AI is a Vector database powered by kd…

Introduction to KDB.AI (4) - Music recommendation (Recommendation Systems)

Introduction Hello, this is Chen from the Lakehouse Department of the GLB Division. The Lakehouse department is conducting verification using KDB.AI on the Databricks platform. An article by our company's Jung introduces KDB.AI and how to …

Introduction to KDB.AI (3) - Sample code (pattern matching of sensor data)

Introduction This is May from the Lakehouse Department of the GLB Division. KX Systems leveraged the time series database kdb+ to release KDB.AI in September 2023. KDB.AI is a powerful knowledge-based vector database and search engine that…

Introduction to KDB.AI (2) - Sample code (document search)

Introduction This is Jung from the Lakehouse Department of the GLB Division. In this article, I would like to introduce the sample code practice of KDB.AI that I introduced in the previous article. KDB.AI is a Vector database powered by kd…

Introduction to KDB.AI (1) - Overview

Introduction This is Jung from the Lakehouse Department of the GLB Division. In this article, we will introduce KDB.AI from KX, a global company that owns KDB, the world's fastest time series database and analysis engine. In order, I will …

A Technical Deep Dive into Unity Catalog's Practitioner Playbook Part 3/3

Upgrading to Unity Catalog: A New Step to Strengthen Data and AI Governance ​This is Johann from the Global Engineering Department of the GLB Division.​ Hello everyone. Today, I will be discussing an essential tool for strengthening data a…

A Technical Deep Dive into Unity Catalog's Practitioner Playbook Part 2/3

Leveraging Unity Catalog: A New Approach to Data and AI Governance ​This is Johann from the Global Engineering Department of the GLB Division. ​ In this post, we will delve into an intriguing presentation on data and AI governance. The tal…

A Technical Deep Dive into Unity Catalog's Practitioner Playbook Part 1/3

Unity Catalog: A New Tool for Centralizing Data and AI Governance ​This is Johann from the Global Engineering Department of the GLB Division. ​ Hello everyone. Today, I bring you an intriguing talk on data and AI governance. The presentati…

A Technical Deep Dive into Unity Catalog's Practitioner Playbook Part 3/3 (Unity Catalog のプラクティショナー ハンドブックの技術的な詳細 Part 3/3)

Unity Catalogへのアップグレード:データとAIのガバナンスを強化する新たなステップ ​​GLB事業部Global Engineering部 ヨハンです。 ​ こんにちは、皆さん。今回は、データとAIのガバナンスを強化するための重要なツール、Unity Catalogについてお話ししま…

A Technical Deep Dive into Unity Catalog's Practitioner Playbook Part 2/3 (Unity Catalog のプラクティショナー ハンドブックの技術的な詳細 Part 2/3)

Unity Catalogの活用:データとAIのガバナンスへの新たなアプローチ ​​GLB事業部Global Engineering部 ヨハンです。 ​ こんにちは、皆さん。今回は、データとAIのガバナンスについての興味深い講演を取り上げます。そのタイトルは「A Technical Deep Dive in…

A Technical Deep Dive into Unity Catalog's Practitioner Playbook Part 1/3 (Unity Catalog のプラクティショナー ハンドブックの技術的な詳細 Part 1/3)

Unity Catalog: データとAIのガバナンスを一元化する新たなツール ​​GLB事業部Global Engineering部 ヨハンです。​ 今回は、データとAIのガバナンスについての興味深い講演を取材してきました。その講演のタイトルは「A Technical Deep Dive into Unity Cata…

Planning and Executing a Snowflake Data Warehouse Migration to Databricks Part 2/2

Planning and Executing Data Warehouse Migration from Snowflake to Databricks ​This is Johann from the Global Engineering Department of the GLB Division. ​ Today, I will be discussing data warehouse migration, specifically focusing on the t…

Planning and Executing a Snowflake Data Warehouse Migration to Databricks Part 1/2

Planning and Executing Data Warehouse Migration from Snowflake to Databricks: An In-depth Look ​This is Johann from the Global Engineering Department of the GLB Division.​ ​ In this article, I would like to discuss data warehouse migration…

Planning and Executing a Snowflake Data Warehouse Migration to Databricks Part 2/2 (Snowflake Data Warehouse の Databricks への移行の計画と実行 Part 2/2)

SnowflakeからDatabricksへのデータウェアハウス移行計画とその実行 ​​GLB事業部Global Engineering部 ヨハンです。 ​ 今日は、データウェアハウスのマイグレーションについてお話しします。特に、SnowflakeからDatabricksへの移行について詳しく解説します…

Planning and Executing a Snowflake Data Warehouse Migration to Databricks Part 1/2 (Snowflake Data Warehouse の Databricks への移行の計画と実行 Part 1/2)

SnowflakeからDatabricksへのデータウェアハウス移行計画と実行:その全貌とは? ​​GLB事業部Global Engineering部 ヨハンです。 ​ 今回は、データウェアハウスのマイグレーション、つまりSnowflakeからDatabricksへの移行について語りたいと思います。この…

Project Aqueduct: Simplify Making Delta Lake Tributaries

Introduction ​This is Johann from the Global Engineering Department of the GLB Division.​ ​ Today, we will be sharing information about a presentation on Project Aqueduct. This presentation discussed the simplification of building connecto…

Project Aqueduct: Simplify Making Delta Lake Tributaries (Project Aqueduct: デルタレイクの支流の作成を簡素化)

はじめに ​​GLB事業部Global Engineering部 ヨハンです。 ​ 今回は、Project Aqueductに関する講演の情報をお届けします。この講演では、DeltaカーネルとDeltaプロトコルを使用したコネクタの構築の簡素化について説明されました。講演のテーマと目的は、複…

Best Practices for Setting Up Databricks SQL at Enterprise Scale

Introduction ​This is Johann from the Global Engineering Department of the GLB Division. ​ Today, I had the opportunity to watch a presentation on best practices for leveraging Databricks SQL at an enterprise scale. This presentation expla…

Best Practices for Setting Up Databricks SQL at Enterprise Scale (エンタープライズ規模で Databricks SQL をセットアップするためのベスト プラクティス)

はじめに ​​GLB事業部Global Engineering部 ヨハンです。 ​ 今回は、エンタープライズスケールでDatabricks SQLを活用するためのベストプラクティスについて紹介した講演を視聴しました。この講演では、データウェアハウスの設定において、Databricks SQLを…

Unlock the Next Evolution of the Modern Data Stack With the Lakehouse Revolution

Introduction This is May from the GLB Division Lakehouse Department. Based on reports from members participating in the local Data + AI SUMMIT 2023 (DAIS), Share "Unlock the Next Evolution of the Modern Data Stack With the Lakehouse Revolu…

Labelbox | Unlocking Enterprise AI with Your Proprietary Data and Foundation Models

Introduction This is May from the GLB Division Lakehouse Department. Based on reports from members participating in the local Data + AI SUMMIT 2023 (DAIS), the exponential progress of AI and computing and the emergence of basic models were…

Develop Like a Pro in Databricks Notebooks Part 2 of 2

New Features in Databricks Notebooks for Professional Development and How to Use Them ​This is Johann from the Global Engineering Department of the GLB Division. ​ Today, I will introduce the new features and usage of Databricks Notebooks,…

Develop Like a Pro in Databricks Notebooks Part 1 of 2

Introduction ​This is Johann from the Global Engineering Department of the GLB Division.​ Today, I bring you coverage of a presentation titled "Develop Like a Pro in Databricks Notebooks". This talk, delivered by Neha, the leader of the No…

Develop Like a Pro in Databricks Notebooks Part 2 of 2 ( Databricks ノートブックでプロのように開発するパート 2/2)

Databricksノートブックでプロのように開発するための新機能とその使い方 ​​GLB事業部Global Engineering部 ヨハンです。 ​ 今回は、データ&AIの世界で話題のDatabricksノートブックについて、その新機能と使い方をご紹介します。この記事は全2部構成の第2部…

Develop Like a Pro in Databricks Notebooks Part 1 of 2 ( Databricks ノートブックでプロのように開発するパート 1/2)

はじめに ​​GLB事業部Global Engineering部 ヨハンです。 今回は、"Develop Like a Pro in Databricks Notebooks"という講演を取材しました。この講演は、Databricksノートブックを使用してプロのように開発する方法を紹介するもので、発表者はノートブック…

Delta Sharing: The Key Data Mesh Enabler Part 2

Introduction ​This is Johann from the Global Engineering Department of the GLB Division.​ ​ In this post, we will discuss the presentation "Delta Sharing: The Key Data Mesh Enabler" by Francesco Pizzolon, a Data Engineering Director at Ava…

Delta Sharing: The Key Data Mesh Enabler Part 2 (デルタ共有: 主要なデータ メッシュ実現要因 Part 2)

はじめに ​​GLB事業部Global Engineering部 ヨハンです。 ​ 今回は、データメッシュとDelta Sharingについての講演「Delta Sharing: The Key Data Mesh Enabler」を取り上げます。講演者は、AvanadeのデータエンジニアリングディレクターであるFrancesco Piz…