Skip to content
Adem Thabti
Docs / Projects / CORA
GET/projects/cora-customer-service

CORA - Customer Service Application

Dynamic workflow-driven customer service platform with RAG-based AI capabilities, semantic search, and intelligent automation for banking operations.

Organization
Proxym Group
Role
Backend Developer & AI Integration Specialist
Period
2024 - Present

Overview

Built CORA (Customer Operations & Relationship Agent), a sophisticated customer service application combining traditional workflow management with cutting-edge AI capabilities. The platform leverages RAG (Retrieval-Augmented Generation) architecture to provide intelligent, context-aware responses to customer queries while maintaining workflow orchestration for complex banking processes. Features semantic caching, vector search, and agent-driven automation to improve efficiency and reduce costs.

Capabilities

  • RAG-based intelligent query answering
  • Semantic search combining full-text and vector retrieval
  • Semantic caching with embedding similarity detection
  • Agent-driven workflow automation
  • Context-aware response generation
  • Automated summarization and analytics
  • Action item extraction from conversations
  • Smart tagging and categorization
  • Knowledge base management
  • Real-time and batch processing modes
  • Token usage optimization
  • Multi-turn conversation support

The problem

Creating an intelligent customer service platform that could handle complex banking workflows while providing AI-driven assistance to customer service representatives. The system needed to reduce response times, minimize manual intervention, and control AI operational costs while maintaining accuracy and security for sensitive banking operations.

Key decisions

AI Cost Optimization

ADR-001 · accepted
context
Reducing LLM API costs while maintaining response quality and accuracy
decision
Implemented semantic caching using embeddings to detect similar queries, optimized prompts and context management, reducing redundant LLM calls and API costs

Accurate Knowledge Retrieval

ADR-002 · accepted
context
Finding relevant information from large knowledge base with high precision
decision
Built hybrid search combining full-text indexing (Elasticsearch) with vector search (pgvector), using reranking and relevance scoring

Workflow and AI Integration

ADR-003 · accepted
context
Seamlessly integrating AI capabilities with traditional BPMN workflows
decision
Developed agent-driven architecture where AI agents act as intelligent task executors within workflow processes

Token Usage Optimization

ADR-004 · accepted
context
Minimizing token consumption without losing context or accuracy
decision
Implemented context windowing, prompt compression, response structuring, and selective context inclusion based on relevance scores

Results

  • Automated routine customer service tasks with AI-driven workflows
  • Lowered AI API costs through semantic caching, which avoids redundant LLM calls
  • Enabled 24/7 intelligent customer support
  • Successfully integrated RAG architecture into production banking environment
  • Built semantic caching with similarity detection to avoid redundant LLM calls
  • Reduced LLM token usage through prompt, response and context optimization
  • Built scalable vector search over the knowledge base
  • Implemented agent-driven workflows improving automation

Stack