{"id":483,"date":"2026-05-06T10:00:00","date_gmt":"2026-05-06T01:00:00","guid":{"rendered":"https:\/\/blog.hancom.com\/the-start-of-rag-llm-preprocessing-hancom-data-loader-document-parsing-solution-transforming-documents-into-ai-training-data\/"},"modified":"2026-08-27T12:41:19","modified_gmt":"2026-08-27T03:41:19","slug":"what-is-hancom-data-loader","status":"publish","type":"post","link":"https:\/\/blog.hancom.com\/en\/what-is-hancom-data-loader\/","title":{"rendered":"The Start of RAG\/LLM Preprocessing: Hancom Data Loader Document Parsing Solution &#8211; Transforming Documents into AI Training Data"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><\/p>\n\n<p class=\"wp-block-paragraph\"><strong><a href=\"https:\/\/sdk.hancom.com\/services\/1?type=DATA_LOADER\" target=\"_blank\" rel=\"noopener\">Hancom Data Loader<\/a> is a document parsing solution developed by Hancom.<\/strong> It is a document data preprocessing technology specialized for RAG-based AI training that helps AI understand HWP, HWPX, PDF, and OOXML.<\/p>\n\n<p class=\"wp-block-paragraph\">Before an agent runs, Hancom Data Loader converts documents into data that AI can understand, separating and extracting content down to semantic units and providing it as agent-friendly metadata.<\/p>\n\n<div style=\"height:11px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<h2 class=\"wp-block-heading\"><strong>Why is document datafication so difficult when adopting enterprise AI?<\/strong><\/h2>\n\n<p class=\"wp-block-paragraph\">This is because large language models (LLMs) cannot read internal documents such as PDF, HWP, and HWPX as-is.<\/p>\n\n<p class=\"wp-block-paragraph\">A common challenge faced by public institutions, enterprise DX teams, and SI partners considering the adoption of in-house AI assistants, RAG (Retrieval Augmented Generation), or agents is handling unstructured documents.<\/p>\n\n<h3 class=\"wp-block-heading\"><strong><strong>Why Document Structuring Is Necessary: The Gap Between LLMs and Unstructured Documents<\/strong><\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\">Enterprises hold vast amounts of materials\u2014manuals, reports, contracts, and official documents in HWP\/HWPX\u2014but not many are in a form that LLMs can use directly. <\/p>\n\n<p class=\"wp-block-paragraph\">In PDFs, table, multi-column, and caption structures can be damaged, and in HWP and HWPX files, extracting only text does not convey meaning accurately. As table row and column order changes, answers can differ from the actual content.  <strong>Only by converting documents into structured data can LLMs properly read internal information. <\/strong><\/p>\n\n<h3 class=\"wp-block-heading\"><strong><strong>Why Document Parsing Quality Matters in a RAG Pipeline<\/strong><\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\">For organizations pursuing AI transformation (AX), structured document data affects not only search but also the reliability of agent judgment and execution.<\/p>\n\n<p class=\"wp-block-paragraph\">In a RAG pipeline, document preprocessing quality is directly reflected in retrieval, decision-making, and execution results.<\/p>\n\n<p class=\"wp-block-paragraph\">If table structure information is lost during parsing, irrelevant text may be included, and during embedding, positions can be distorted and mapped incorrectly.<\/p>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-what-is-intro-1-1024x576.png\" alt=\"An introductory image showing that Hancom Data Loader is a document parsing solution that converts HWP, HWPX, PDF, and OOXML documents into structured data\" class=\"wp-image-1300\" srcset=\"https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-what-is-intro-1-1024x576.png 1024w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-what-is-intro-1-300x169.png 300w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-what-is-intro-1-768x432.png 768w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-what-is-intro-1-600x338.png 600w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-what-is-intro-1.png 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<h2 class=\"wp-block-heading\"><strong><strong>Document parsing solution: definition and core role of Hancom Data Loader<\/strong><\/strong><\/h2>\n\n<h3 class=\"wp-block-heading\"><strong>Hancom Data Loader: an automated document parsing solution<\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\"><strong><a href=\"https:\/\/sdk.hancom.com\/services\/1?type=DATA_LOADER\" data-type=\"link\" data-id=\"https:\/\/sdk.hancom.com\/services\/1?type=DATA_LOADER\" target=\"_blank\" rel=\"noopener\">Hancom Data Loader<\/a> is a document parsing solution developed by Hancom.<\/strong> It converts various document formats such as HWP, HWPX, PDF, and OOXML into structured data that AI can understand, and can be used to build RAG-based knowledge search systems, secure training data for Large Language Models (LLMs), and digitize corporate documents.<\/p>\n\n<p class=\"wp-block-paragraph\">It separates and extracts document semantic units\u2014including tables, titles, captions, and hierarchical structures\u2014along with OCR (Optical Character Recognition)\u2013based extraction, and provides them as agent-friendly metadata. As a document structure-preserving extraction method rather than general OCR, it is establishing itself as a core preprocessing technology for building RAG systems. <br\/>It analyzes documents based on DLA (Document Layout Analysis), OCR, and TSR (Table Structure Recognition), distinguishing document components such as text, tables, and images while extracting structural information together. Its key feature is going beyond simple text extraction to separate semantic units within documents and provide them as metadata. <\/p>\n\n<p class=\"wp-block-paragraph\">In addition, HWP and HWPX documents provide paragraph-based hierarchical structure information, and PDF AI supports visual information interpretation functions based on Image Captioning.<\/p>\n\n<p class=\"wp-block-paragraph\">(\u203b The image captioning function is currently in the PoC stage, and the commercial release schedule will be announced later.)<\/p>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<h3 class=\"wp-block-heading\"><strong>From Document Structure Analysis to Data Extraction<\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\">Hancom Data Loader generates structured data through a three-step processing flow: <strong>document input \u2192 document analysis \u2192 data extraction<\/strong>. The extracted data can then be linked with RAG pipelines and LLMs to build AI services. <\/p>\n\n<p class=\"wp-block-paragraph\">In the document analysis stage, it runs two engines in parallel: rules-based analysis and AI-based document structure understanding. Structured documents with consistent formats are handled with rules, while unstructured documents that mix figures, tables, and images are analyzed precisely with AI.  <\/p>\n\n<p class=\"wp-block-paragraph\">It provides, in a single processing flow, the core capabilities required for document preprocessing\u2014recognizing diverse document elements, detecting multi-column reading order, and extracting complex table and chart structures.<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>The extracted structured data can be directly integrated with Hancom\u2019s proprietary RAG solution, HancomPedia, enabling rapid deployment of a document-based AI search system. <\/strong><\/p>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-ai-document-processing-flow-1-1024x576.png\" alt=\"A diagram illustrating Hancom Data Loader's AI document processing and data utilization process in four stages: document input, document analysis, data extraction, and data utilization\" class=\"wp-image-1301\" srcset=\"https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-ai-document-processing-flow-1-1024x576.png 1024w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-ai-document-processing-flow-1-300x169.png 300w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-ai-document-processing-flow-1-768x432.png 768w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-ai-document-processing-flow-1-600x338.png 600w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-ai-document-processing-flow-1.png 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<h3 class=\"wp-block-heading\"><strong>Document Data Extraction Targets: Support for Multiple Document Formats<\/strong><\/h3>\n\n<h4 class=\"wp-block-heading\"><strong><strong>Core Format Support for Public-Sector AI Adoption: HWP\/HWPX Parsing<\/strong><\/strong><\/h4>\n\n<p class=\"wp-block-paragraph\">As the government moves to expand HWPX usage from 2026 and <a href=\"https:\/\/www.yna.co.kr\/view\/AKR20260423082600017\" target=\"_blank\" rel=\"noopener\">gradually restrict HWP attachments<\/a>, <strong>full support for HWP and HWPX is becoming a prerequisite for public-sector AI adoption<\/strong>. Hancom Data Loader supports all HWP versions from 3.0 onward, and with a parser developed in-house by Hancom, it preserves a wide range of layout elements <strong>without loss<\/strong> <strong>without converting to PDF<\/strong>. <\/p>\n\n<h4 class=\"wp-block-heading\"><strong>Universal Support for All Document Formats \u2013 PDF and OOXML<\/strong><\/h4>\n\n<p class=\"wp-block-paragraph\">PDF AI handles structure analysis and table structure restoration through DLA, TSR, and OCR, and minimizes data loss in scanned documents through OCR integration. OOXML extracts text from office documents using a text extraction method. <\/p>\n\n<h4 class=\"wp-block-heading\"><strong>Unstructured Visual Documents: PNG\/JPG<\/strong><\/h4>\n\n<p class=\"wp-block-paragraph\">PNG and JPG recognize text and structure to datafy even non-digitized materials such as fax documents, scanned images, and photographed documents.<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>\ud83d\udc49<\/strong><a href=\"https:\/\/livedemo.sdk.hancom.com\/dataloader\" target=\"_blank\" rel=\"noopener\"><strong>Go to Hancom Data Loader Live Demo<\/strong><\/a><\/p>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<h2 class=\"wp-block-heading\"><strong><strong><strong>Key Features of Hancom Data Loader: DLA\/TSR\/OCR-Based Document Structure Analysis<\/strong><\/strong><\/strong><\/h2>\n\n<h3 class=\"wp-block-heading\"><strong><strong><strong>DLA \u2013 AI-Based Structure Analysis That Extracts Metadata<\/strong><\/strong><\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\">Hancom Data Loader&#8217;s DLA classifies objects into categories and extracts tables, footnotes, images, charts, captions, formulas, and even fonts as metadata.<\/p>\n\n<p class=\"wp-block-paragraph\">When metadata is extracted together, RAG retrieval accuracy improves, enabling policy search, administrative QA, and internal knowledge agents to use highly reliable data.<\/p>\n\n<h3 class=\"wp-block-heading\"><strong><strong><strong>Table\/Image\/Chart Structure Recognition: TSR Technology at the Core of Unstructured Data Processing<\/strong><\/strong><\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\">Key information in corporate documents is often concentrated in tables and charts rather than the main text. Based on TSR, Hancom Data Loader restores cell relationships\u2014including borderless tables, merged cells, and tables within tables\u2014to convert them into Markdown or HTML, and improves AI result quality by preserving multi-column layouts. <\/p>\n\n<h3 class=\"wp-block-heading\"><strong>Data Separation and Post-Editing: Data Loader Studio<\/strong><\/h3>\n\n<p class=\"wp-block-paragraph\">For documents where accuracy is difficult to ensure through automatic extraction alone, Data Loader Studio (an extended solution) is provided. Extraction results preprocessed by Data Loader can be reviewed side-by-side with the original document. Users can directly verify hierarchy, categories, reading order, and more, and post-correct necessary parts, enabling them to manage document structure and semantic relationships to fit actual business purposes.  <\/p>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-usage-flow-1-1024x576.png\" alt=\"A workflow diagram showing the process from document upload through RAG solution integration to user search and answers using Hancom Data Loader\" class=\"wp-image-1302\" srcset=\"https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-usage-flow-1-1024x576.png 1024w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-usage-flow-1-300x169.png 300w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-usage-flow-1-768x432.png 768w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-usage-flow-1-600x338.png 600w, https:\/\/blog.hancom.com\/wp-content\/uploads\/2026\/05\/hancom-data-loader-usage-flow-1.png 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n<h2 class=\"wp-block-heading\"><strong>Hancom Data Loader for document-based AI<\/strong><\/h2>\n\n<h3 class=\"wp-block-heading\"><strong>\ud83d\udda5\ufe0f<\/strong><a href=\"https:\/\/sdk.hancom.com\/services\/1?type=DATA_LOADER\" data-type=\"link\" data-id=\"https:\/\/sdk.hancom.com\/services\/1?type=DATA_LOADER\" target=\"_blank\" rel=\"noopener\"><strong>Hancom Data Loader<\/strong><\/a><\/h3>\n\n<p class=\"wp-block-paragraph\"><strong><a href=\"https:\/\/blog.hancom.com\/en\/hancom-data-loader-startguide\/\">Hancom Data Loader<\/a> is a document parsing solution that converts HWP, HWPX, PDF, and OOXML into structured data<\/strong>. The extracted data can be integrated with Hancom\u2019s RAG solution, Hancompedia, enabling an end-to-end workflow\u2014from document collection to search and answers\u2014built on a single Hancom stack. Hancom Data Loader provides a document preprocessing environment that agents can trust.  <\/p>\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/livedemo.sdk.hancom.com\/dataloader\" target=\"_blank\" rel=\"noopener\"><strong>\ud83d\udc49Go to Hancom Data Loader Live Demo<\/strong><\/a><\/p>\n\n<p class=\"wp-block-paragraph\"><strong>\ud83d\udc49<\/strong><a href=\"https:\/\/sdk.hancom.com\/contacts\/create\" target=\"_blank\" rel=\"noopener\"><strong>Inquire about Hancom Data Loader Implementation<\/strong><\/a><\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<p class=\"wp-block-paragraph\"><strong>References<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">1) <a href=\"https:\/\/www.yna.co.kr\/view\/AKR20260423082600017\" data-type=\"link\" data-id=\"https:\/\/www.yna.co.kr\/view\/AKR20260423082600017\" target=\"_blank\" rel=\"noopener\"><strong>Yonhap News<\/strong><\/a>, \u201c&#8221;Reducing hwp that AI can\u2019t read&#8221;\u2026 Government to transition to open hwpx,\u201d 2026<\/p>\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hancom Data Loader is a document data preprocessing technology specialized for RAG-based AI training that helps AI understand HWP, HWPX, PDF, and OOXML. We have compiled everything you need to know about Data Loader, a core preprocessing technology for building RAG solutions and implementing corporate AI. <\/p>\n","protected":false},"author":2,"featured_media":1304,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30],"tags":[],"class_list":["post-483","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-hancom-product-user-guide"],"_links":{"self":[{"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/posts\/483","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/comments?post=483"}],"version-history":[{"count":13,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/posts\/483\/revisions"}],"predecessor-version":[{"id":1855,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/posts\/483\/revisions\/1855"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/media\/1304"}],"wp:attachment":[{"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/media?parent=483"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/categories?post=483"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.hancom.com\/en\/wp-json\/wp\/v2\/tags?post=483"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}