Skip to Content (Press Enter)
Community › Forge › Assets list › Chunk Library Demo
Login to follow
Chunk Library Demo

Chunk Library Demo (ODC)

Stable version 0.1.1 (Compatible with ODC)
Uploaded on 18 Jun by Michael Guzman
Chunk Library Demo

Chunk Library Demo (ODC)

Details
Detailed Description

ChunkLibraryDemo is an ODC sample app that demonstrates how to integrate and test text chunking capabilities in a real application. It supports multiple chunking strategies, configurable parameters, sample Markdown and text inputs, chunk previews, metadata inspection, token estimates, and JSON export. This sample helps developers accelerate implementations for AI-assisted experiences, document processing, semantic search, and retrieval workflows by providing a clear, practical reference for chunking structured and unstructured content.

Limitations
  • This is a demo application and is not intended as a production-ready document processing solution
  • It is designed to demonstrate integration with the chunking library inside an ODC app
  • It supports sample files and manually entered text, but not a complete ingestion pipeline
  • It does not include file upload, batch execution, scheduling, or background processing
  • It does not persist submitted content or generated chunk results
  • JSON export is included, but downstream storage, indexing, and retrieval workflows are outside the scope of the app
  • The UI illustrates one implementation approach and is intended as a reference, not a final end-user experience
Release notes 

This release adds a new Semantic Chunk sample screen to the app, expanding the sample experience beyond the existing chunking demo.

Added

  • New SemanticChunk screen to demonstrate semantic chunking workflows
  • Profile-based semantic chunking workbench UI
  • Left-side profile list for selecting test cases
  • Workspace layout for reviewing:
    • selected profile
    • description
    • document id
    • expected behaviour
    • suggested parameters

Semantic analysis flow

  • Added support to run semantic chunk analysis directly from the new screen
  • Connected the screen to the semantic chunking action
  • Added editable parameter inputs for:
    • threshold percentage
    • window size
    • max chunk size
    • overlap text units
    • chunking pattern
    • sensitivity K
  • Added chunking pattern dropdown support

Results experience

  • Added text unit preview for the selected profile
  • Added chunk results panel for returned semantic chunks
  • Added execution status area and run action inside the workspace
  • Added JSON export for the selected semantic result

Saved results per profile

  • Added persistence for semantic analysis results by profile
  • Returning to a previously analyzed profile now reloads its saved result
  • Added server-side persistence logic to save and update semantic profile results

Supporting data model and logic

  • Added semantic profile result storage
  • Added supporting structures and sample data handling for semantic test profiles
  • Added semantic test case loading from bundled sample data
  • Added initialization, selection, reset, and saved-result restore logic

UI and styling

  • Added a dedicated semantic workbench layout and styling
  • Moved semantic workbench styling into the app theme
  • Improved styling organization and formatting
  • Added execution bar and workbench presentation based on the semantic chunk sample design