busya/ss-tools
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

semantic update

Browse Source
This commit is contained in:
busya
2026-02-08 22:53:54 +03:00
parent e6087bd3c1
commit 235b0e3c9f
71 changed files with 68034 additions and 62417 deletions
Download Patch File Download Diff File Expand all files Collapse all files

499
specs/project_map.md
View File

@@ -131,33 +131,33 @@
- 📝 Clears authentication state and storage.
- ƒ **setLoading** (`Function`)
- 📝 Updates the loading state.
- 🧩 **Select** (`Component`)
- 🧩 **Select** (`Component`) `[TRIVIAL]`
- 📝 Standardized dropdown selection component.
- 🏗️ Layer: Atom
- 📥 Props: label: string , value: string | number , disabled: boolean
- 📦 **ui** (`Module`)
- 📦 **ui** (`Module`) `[TRIVIAL]`
- 📝 Central export point for standardized UI components.
- 🏗️ Layer: Atom
- 🔒 Invariant: All components exported here must follow Semantic Protocol.
- 🧩 **PageHeader** (`Component`)
- 🧩 **PageHeader** (`Component`) `[TRIVIAL]`
- 📝 Standardized page header with title and action area.
- 🏗️ Layer: Atom
- 📥 Props: title: string
- 🧩 **Card** (`Component`)
- 🧩 **Card** (`Component`) `[TRIVIAL]`
- 📝 Standardized container with padding and elevation.
- 🏗️ Layer: Atom
- 📥 Props: title: string
- 🧩 **Button** (`Component`)
- 🧩 **Button** (`Component`) `[TRIVIAL]`
- 📝 Define component interface and default values.
- 🏗️ Layer: Atom
- 🔒 Invariant: Supports accessible labels and keyboard navigation.
- 📥 Props: isLoading: boolean , disabled: boolean
- 🧩 **Input** (`Component`)
- 🧩 **Input** (`Component`) `[TRIVIAL]`
- 📝 Standardized text input component with label and error handling.
- 🏗️ Layer: Atom
- 🔒 Invariant: Consistent spacing and focus states.
- 📥 Props: label: string , value: string , placeholder: string , error: string , disabled: boolean
- 🧩 **LanguageSwitcher** (`Component`)
- 🧩 **LanguageSwitcher** (`Component`) `[TRIVIAL]`
- 📝 Dropdown component to switch between supported languages.
- 🏗️ Layer: Atom
- ⬅️ READS_FROM `lib`
@@ -237,7 +237,7 @@
- ƒ **handleDeleteUser** (`Function`)
- 📝 Deletes a user after confirmation.
- 🧩 **AdminSettingsPage** (`Component`)
- 📝 UI for configuring Active Directory Group to local Role mappings for ADFS SSO.
- 📝 UI for configuring Active Directory Group to local Role mappings for ADFS SSO and logging settings.
- 🏗️ Layer: Feature
- 🔒 Invariant: Only accessible by users with "admin:settings" permission.
- ⬅️ READS_FROM `lib`
@@ -247,6 +247,10 @@
- 📝 Fetches AD mappings and roles from the backend to populate the UI.
- ƒ **handleCreateMapping** (`Function`)
- 📝 Submits a new AD Group to Role mapping to the backend.
- ƒ **loadLoggingConfig** (`Function`)
- 📝 Fetches current logging configuration from the backend.
- ƒ **saveLoggingConfig** (`Function`)
- 📝 Saves logging configuration to the backend.
- 🧩 **LLMSettingsPage** (`Component`)
- 📝 Admin settings page for LLM provider configuration.
- 🏗️ Layer: UI
@@ -305,11 +309,11 @@
- 📝 Updates the current path and reloads files when navigating into a directory.
- ƒ **navigateUp** (`Function`)
- 📝 Navigates one level up in the directory structure.
- 🧩 **MapperPage** (`Component`)
- 🧩 **MapperPage** (`Component`) `[TRIVIAL]`
- 📝 Page for the dataset column mapper tool.
- 🏗️ Layer: UI
- ⬅️ READS_FROM `lib`
- 🧩 **DebugPage** (`Component`)
- 🧩 **DebugPage** (`Component`) `[TRIVIAL]`
- 📝 Page for system diagnostics and debugging.
- 🏗️ Layer: UI
- ⬅️ READS_FROM `lib`
@@ -423,6 +427,10 @@
- 📝 Deletes a role.
- ƒ **getPermissions** (`Function`)
- 📝 Fetches all available permissions.
- ƒ **getLoggingConfig** (`Function`)
- 📝 Fetches current logging configuration.
- ƒ **updateLoggingConfig** (`Function`)
- 📝 Updates logging configuration.
- ƒ **getTasks** (`Function`)
- 📝 Fetch a list of tasks with pagination and optional status filter.
- ƒ **getTask** (`Function`)
@@ -438,6 +446,8 @@
- 📦 **storageService** (`Module`)
- 📝 Frontend API client for file storage management.
- 🏗️ Layer: Service
- ƒ **getStorageAuthHeaders** (`Function`)
- 📝 Returns headers with Authorization for storage API calls.
- ƒ **listFiles** (`Function`)
- 📝 Fetches the list of files for a given category and subpath.
- ƒ **uploadFile** (`Function`)
@@ -465,7 +475,7 @@
- ƒ **getSuggestion** (`Function`)
- 📝 Finds a suggestion for a source database.
- 🧩 **TaskLogViewer** (`Component`)
- 📝 Displays detailed logs for a specific task in a modal or inline.
- 📝 Displays detailed logs for a specific task in a modal or inline using TaskLogPanel.
- 🏗️ Layer: UI
- 📥 Props: show: any, inline: any, taskId: any, taskStatus: any
- ⚡ Events: close
@@ -473,17 +483,16 @@
- ➡️ WRITES_TO `t`
- ƒ **fetchLogs** (`Function`)
- 📝 Fetches logs for the current task.
- ƒ **scrollToBottom** (`Function`)
- 📝 Scrolls the log container to the bottom.
- ƒ **handleScroll** (`Function`)
- 📝 Updates auto-scroll preference based on scroll position.
- ƒ **close** (`Function`)
- 📝 Closes the log viewer modal.
- ƒ **getLogLevelColor** (`Function`)
- 📝 Returns the CSS color class for a given log level.
- ƒ **onDestroy** (`Function`)
- 📝 Cleans up the polling interval.
- 🧩 **Footer** (`Component`)
- 📦 **TaskLogViewer** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for frontend/src/components/TaskLogViewer.svelte
- 🏗️ Layer: Unknown
- ƒ **handleFilterChange** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 🧩 **Footer** (`Component`) `[TRIVIAL]`
- 📝 Displays the application footer with copyright information.
- 🏗️ Layer: UI
- 🧩 **MissingMappingModal** (`Component`)
@@ -544,32 +553,33 @@
- 📝 Initializes the component by fetching tasks and starting polling.
- ƒ **onDestroy** (`Function`)
- 📝 Cleans up the polling interval when the component is destroyed.
- 🧩 **Toast** (`Component`)
- 🧩 **Toast** (`Component`) `[TRIVIAL]`
- 📝 Displays transient notifications (toasts) in the bottom-right corner.
- 🏗️ Layer: UI
- ⬅️ READS_FROM `toasts`
- 🧩 **TaskRunner** (`Component`)
- 📝 Connects to a WebSocket to display real-time logs for a running task.
- 📝 Connects to a WebSocket to display real-time logs for a running task with filtering support.
- 🏗️ Layer: UI
- ⬅️ READS_FROM `selectedTask`
- ➡️ WRITES_TO `selectedTask`
- ⬅️ READS_FROM `taskLogs`
- ➡️ WRITES_TO `taskLogs`
- ƒ **connect** (`Function`)
- 📝 Establishes WebSocket connection with exponential backoff.
- 📝 Establishes WebSocket connection with exponential backoff and filter parameters.
- ƒ **handleFilterChange** (`Function`)
- 📝 Handles filter changes and reconnects WebSocket with new parameters.
- ƒ **fetchTargetDatabases** (`Function`)
- 📝 Fetches the list of databases in the target environment.
- 📝 Fetches available databases from target environment for mapping.
- ƒ **handleMappingResolve** (`Function`)
- 📝 Handles the resolution of a missing database mapping.
- 📝 Resolves missing database mapping and continues migration.
- ƒ **handlePasswordResume** (`Function`)
- 📝 Handles the submission of database passwords to resume a task.
- 📝 Submits passwords and resumes paused migration task.
- ƒ **startDataTimeout** (`Function`)
- 📝 Starts a timeout to detect when the log stream has stalled.
- 📝 Starts timeout timer to detect idle connection.
- ƒ **resetDataTimeout** (`Function`)
- 📝 Resets the data stall timeout.
- 📝 Resets data timeout timer when new data arrives.
- ƒ **onMount** (`Function`)
- 📝 Initializes the component and subscribes to task selection changes.
- 📝 Initializes WebSocket connection when component mounts.
- ƒ **onDestroy** (`Function`)
- 📝 Close WebSocket connection when the component is destroyed.
- 🧩 **TaskList** (`Component`)
- 📝 Displays a list of tasks with their status and execution details.
- 🏗️ Layer: Component
@@ -600,12 +610,53 @@
- ⚡ Events: change
- ƒ **handleSelect** (`Function`)
- 📝 Dispatches the selection change event.
- 🧩 **ProtectedRoute** (`Component`)
- 🧩 **ProtectedRoute** (`Component`) `[TRIVIAL]`
- 📝 Wraps content to ensure only authenticated users can access it.
- 🏗️ Layer: Component
- 🔒 Invariant: Redirects to /login if user is not authenticated.
- ⬅️ READS_FROM `app`
- ⬅️ READS_FROM `auth`
- 🧩 **TaskLogPanel** (`Component`)
- 📝 Scrolls the log container to the bottom.
- 🏗️ Layer: UI
- 🔒 Invariant: Must always display logs in chronological order and respect auto-scroll preference.
- 📥 Props: taskId: any, logs: any, autoScroll: any
- ⚡ Events: filterChange
- 📦 **TaskLogPanel** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for frontend/src/components/tasks/TaskLogPanel.svelte
- 🏗️ Layer: Unknown
- ƒ **handleFilterChange** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **scrollToBottom** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 🧩 **LogFilterBar** (`Component`)
- 📝 UI component for filtering logs by level, source, and text search. -->
- 🏗️ Layer: UI -->
- 📥 Props: availableSources: any, selectedLevel: any, selectedSource: any, searchText: any
- 📦 **LogFilterBar** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for frontend/src/components/tasks/LogFilterBar.svelte
- 🏗️ Layer: Unknown
- ƒ **handleLevelChange** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **handleSourceChange** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **handleSearchChange** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **clearFilters** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 🧩 **LogEntryRow** (`Component`)
- 📝 Optimized row rendering for a single log entry with color coding and progress bar support. -->
- 🏗️ Layer: UI -->
- 📥 Props: log: any, showSource: any
- 📦 **LogEntryRow** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for frontend/src/components/tasks/LogEntryRow.svelte
- 🏗️ Layer: Unknown
- ƒ **formatTime** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **getLevelClass** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **getSourceClass** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 🧩 **FileList** (`Component`)
- 📝 Displays a table of files with metadata and actions.
- 🏗️ Layer: UI
@@ -782,14 +833,20 @@
- 🏗️ Layer: Unknown
- ƒ **getStatusColor** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **test_auth_debug** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for backend/test_auth_debug.py
- 🏗️ Layer: Unknown
- ƒ **main** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **backend.delete_running_tasks** (`Module`)
- 📝 Script to delete tasks with RUNNING status from the database.
- 🏗️ Layer: Utility
- ƒ **delete_running_tasks** (`Function`)
- 📝 Delete all tasks with RUNNING status from the database.
- 📦 **AppModule** (`Module`)
- 📦 **AppModule** (`Module`) `[CRITICAL]`
- 📝 The main entry point for the FastAPI application. It initializes the app, configures CORS, sets up dependencies, includes API routers, and defines the WebSocket endpoint for log streaming.
- 🏗️ Layer: UI (API)
- 🔒 Invariant: All WebSocket connections must be properly cleaned up on disconnect.
- 📦 **App** (`Global`)
- 📝 The global FastAPI application instance.
- ƒ **startup_event** (`Function`)
@@ -798,8 +855,8 @@
- 📝 Handles application shutdown tasks, such as stopping the scheduler.
- ƒ **log_requests** (`Function`)
- 📝 Middleware to log incoming HTTP requests and their response status.
- ƒ **websocket_endpoint** (`Function`)
- 📝 Provides a WebSocket endpoint for real-time log streaming of a task.
- ƒ **websocket_endpoint** (`Function`) `[CRITICAL]`
- 📝 Provides a WebSocket endpoint for real-time log streaming of a task with server-side filtering.
- 📦 **StaticFiles** (`Mount`)
- 📝 Mounts the frontend build directory to serve static assets.
- ƒ **serve_spa** (`Function`)
@@ -808,6 +865,8 @@
- 📝 A simple root endpoint to confirm that the API is running when frontend is missing.
- ƒ **network_error_handler** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **matches_filters** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **Dependencies** (`Module`)
- 📝 Manages the creation and provision of shared application dependencies, such as the PluginLoader and TaskManager, to avoid circular imports.
- 🏗️ Layer: Core
@@ -1038,6 +1097,10 @@
- 📝 Context manager for structured Belief State logging.
- ƒ **configure_logger** (`Function`)
- 📝 Configures the logger with the provided logging settings.
- ƒ **get_task_log_level** (`Function`)
- 📝 Returns the current task log level filter.
- ƒ **should_log_task_level** (`Function`)
- 📝 Checks if a log level should be recorded based on task_log_level setting.
- ℂ **WebSocketLogHandler** (`Class`)
- 📝 A custom logging handler that captures log records into a buffer. It is designed to be extended for real-time log streaming over WebSockets.
- ƒ **__init__** (`Function`)
@@ -1290,6 +1353,30 @@
- 🔗 CALLS -> `self.load_excel_mappings`
- 🔗 CALLS -> `superset_client.get_dataset`
- 🔗 CALLS -> `superset_client.update_dataset`
- 📦 **TaskLoggerModule** (`Module`) `[CRITICAL]`
- 📝 Provides a dedicated logger for tasks with automatic source attribution.
- 🏗️ Layer: Core
- 🔒 Invariant: Each TaskLogger instance is bound to a specific task_id and default source.
- 🔗 DEPENDS_ON -> `TaskManager, CALLS -> TaskManager._add_log`
- ℂ **TaskLogger** (`Class`) `[CRITICAL]`
- 📝 A wrapper around TaskManager._add_log that carries task_id and source context.
- 🔒 Invariant: All log calls include the task_id and source.
- ƒ **__init__** (`Function`)
- 📝 Initialize the TaskLogger with task context.
- ƒ **with_source** (`Function`)
- 📝 Create a sub-logger with a different default source.
- ƒ **_log** (`Function`)
- 📝 Internal method to log a message at a given level.
- ƒ **debug** (`Function`)
- 📝 Log a DEBUG level message.
- ƒ **info** (`Function`)
- 📝 Log an INFO level message.
- ƒ **warning** (`Function`)
- 📝 Log a WARNING level message.
- ƒ **error** (`Function`)
- 📝 Log an ERROR level message.
- ƒ **progress** (`Function`)
- 📝 Log a progress update with percentage.
- 📦 **TaskPersistenceModule** (`Module`)
- 📝 Handles the persistence of tasks using SQLAlchemy and the tasks.db database.
- 🏗️ Layer: Core
@@ -1306,18 +1393,45 @@
- 📝 Loads tasks from the database.
- ƒ **delete_tasks** (`Function`)
- 📝 Deletes specific tasks from the database.
- ℂ **TaskLogPersistenceService** (`Class`) `[CRITICAL]`
- 📝 Provides methods to save and query task logs from the task_logs table.
- 🔒 Invariant: Log entries are batch-inserted for performance.
- 🔗 DEPENDS_ON -> `TaskLogRecord`
- ƒ **__init__** (`Function`)
- 📝 Initialize the log persistence service.
- ƒ **add_logs** (`Function`)
- 📝 Batch insert log entries for a task.
- ƒ **get_logs** (`Function`)
- 📝 Query logs for a task with filtering and pagination.
- ƒ **get_log_stats** (`Function`)
- 📝 Get statistics about logs for a task.
- ƒ **get_sources** (`Function`)
- 📝 Get unique sources for a task's logs.
- ƒ **delete_logs_for_task** (`Function`)
- 📝 Delete all logs for a specific task.
- ƒ **delete_logs_for_tasks** (`Function`)
- 📝 Delete all logs for multiple tasks.
- ƒ **json_serializable** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **TaskManagerModule** (`Module`)
- 📝 Manages the lifecycle of tasks, including their creation, execution, and state tracking. It uses a thread pool to run plugins asynchronously.
- 🏗️ Layer: Core
- 🔒 Invariant: Task IDs are unique.
- ℂ **TaskManager** (`Class`)
- ℂ **TaskManager** (`Class`) `[CRITICAL]`
- 📝 Manages the lifecycle of tasks, including their creation, execution, and state tracking.
- 🔒 Invariant: Log entries are never deleted after being added to a task.
- ƒ **__init__** (`Function`)
- 📝 Initialize the TaskManager with dependencies.
- ƒ **_flusher_loop** (`Function`)
- 📝 Background thread that periodically flushes log buffer to database.
- ƒ **_flush_logs** (`Function`)
- 📝 Flush all buffered logs to the database.
- ƒ **_flush_task_logs** (`Function`)
- 📝 Flush logs for a specific task immediately.
- ƒ **create_task** (`Function`)
- 📝 Creates and queues a new task for execution.
- ƒ **_run_task** (`Function`)
- 📝 Internal method to execute a task.
- 📝 Internal method to execute a task with TaskContext support.
- ƒ **resolve_task** (`Function`)
- 📝 Resumes a task that is awaiting mapping.
- ƒ **wait_for_resolution** (`Function`)
@@ -1331,15 +1445,13 @@
- ƒ **get_tasks** (`Function`)
- 📝 Retrieves tasks with pagination and optional status filter.
- ƒ **get_task_logs** (`Function`)
- 📝 Retrieves logs for a specific task with filtering and pagination.
- 📝 Retrieves logs for a specific task (from memory for running, persistence for completed).
- ƒ **get_task_log_stats** (`Function`)
- 📝 Returns log statistics (counts by level/source) for a task.
- 📝 Get statistics about logs for a task.
- ƒ **get_task_log_sources** (`Function`)
- 📝 Returns unique log sources for a task.
- 📝 Get unique sources for a task's logs.
- ƒ **_add_log** (`Function`)
- 📝 Adds a log entry to a task, buffers for persistence, and notifies subscribers.
- ƒ **_flush_logs** (`Function`)
- 📝 Flushes buffered logs to the database.
- 📝 Adds a log entry to a task buffer and notifies subscribers.
- ƒ **subscribe_logs** (`Function`)
- 📝 Subscribes to real-time logs for a task.
- ƒ **unsubscribe_logs** (`Function`)
@@ -1351,55 +1463,64 @@
- ƒ **resume_task_with_password** (`Function`)
- 📝 Resume a task that is awaiting input with provided passwords.
- ƒ **clear_tasks** (`Function`)
- 📝 Clears tasks based on status filter.
- 📦 **TaskLogPersistenceModule** (`Module`)
- <20> Handles the persistence of task logs in a dedicated database table.
- 🏗️ Layer: Core
- ℂ **TaskLogPersistenceService** (`Class`)
- 📝 Provides CRUD operations for task logs.
- ƒ **save_log** (`Function`)
- 📝 Saves a single log entry.
- ƒ **bulk_save** (`Function`)
- 📝 Performs batch insertion of log entries.
- ƒ **get_logs** (`Function`)
- 📝 Retrieves logs with filtering and pagination.
- ƒ **get_stats** (`Function`)
- 📝 Returns log counts by level and source.
- ƒ **delete_logs** (`Function`)
- 📝 Deletes all logs for a specific task.
- 📦 **TaskContextModule** (`Module`)
- 📝 Provides execution context and logging utilities to plugins.
- 🏗️ Layer: Core
- ℂ **TaskLogger** (`Class`)
- 📝 Per-task logger with source attribution.
- ƒ **with_source** (`Function`)
- 📝 Returns a new logger instance with a different source.
- ℂ **TaskContext** (`Class`)
- 📝 Container for task-specific resources (logger, config, etc.).
- 📝 Clears tasks based on status filter (also deletes associated logs).
- 📦 **TaskManagerModels** (`Module`)
- 📝 Defines the data models and enumerations used by the Task Manager.
- 🏗️ Layer: Core
- 🔒 Invariant: Task IDs are immutable once created.
- 📦 **TaskStatus** (`Enum`)
- 📦 **TaskStatus** (`Enum`) `[TRIVIAL]`
- 📝 Defines the possible states a task can be in during its lifecycle.
- ℂ **LogEntry** (`Class`)
- 📦 **LogLevel** (`Enum`)
- 📝 Defines the possible log levels for task logging.
- ℂ **LogEntry** (`Class`) `[CRITICAL]`
- 📝 A Pydantic model representing a single, structured log entry associated with a task.
- 🔒 Invariant: Each log entry has a unique timestamp and source.
- ℂ **TaskLog** (`Class`)
- 📝 A Pydantic model representing a persisted log entry from the database.
- ℂ **LogFilter** (`Class`)
- 📝 Filter parameters for querying task logs.
- ℂ **LogStats** (`Class`)
- 📝 Statistics about log entries for a task.
- ℂ **Task** (`Class`)
- 📝 A Pydantic model representing a single execution instance of a plugin, including its status, parameters, and logs.
- ƒ **__init__** (`Function`)
- 📝 Initializes the Task model and validates input_request for AWAITING_INPUT status.
- 📦 **TaskCleanupModule** (`Module`)
- 📝 Implements task cleanup and retention policies.
- 📝 Implements task cleanup and retention policies, including associated logs.
- 🏗️ Layer: Core
- ℂ **TaskCleanupService** (`Class`)
- 📝 Provides methods to clean up old task records.
- 📝 Provides methods to clean up old task records and their associated logs.
- ƒ **__init__** (`Function`)
- 📝 Initializes the cleanup service with dependencies.
- ƒ **run_cleanup** (`Function`)
- 📝 Deletes tasks older than the configured retention period.
- 📦 **TaskManagerPackage** (`Module`)
- 📝 Deletes tasks older than the configured retention period and their logs.
- ƒ **delete_task_with_logs** (`Function`)
- 📝 Delete a single task and all its associated logs.
- 📦 **TaskManagerPackage** (`Module`) `[TRIVIAL]`
- 📝 Exports the public API of the task manager package.
- 🏗️ Layer: Core
- 📦 **TaskContextModule** (`Module`) `[CRITICAL]`
- 📝 Provides execution context passed to plugins during task execution.
- 🏗️ Layer: Core
- 🔒 Invariant: Each TaskContext is bound to a single task execution.
- 🔗 DEPENDS_ON -> `TaskLogger, USED_BY -> plugins`
- ℂ **TaskContext** (`Class`) `[CRITICAL]`
- 📝 A container passed to plugin.execute() providing the logger and other task-specific utilities.
- 🔒 Invariant: logger is always a valid TaskLogger instance.
- ƒ **__init__** (`Function`)
- 📝 Initialize the TaskContext with task-specific resources.
- ƒ **task_id** (`Function`)
- 📝 Get the task ID.
- ƒ **logger** (`Function`)
- 📝 Get the TaskLogger instance for this context.
- ƒ **params** (`Function`)
- 📝 Get the task parameters.
- ƒ **get_param** (`Function`)
- 📝 Get a specific parameter value with optional default.
- ƒ **create_sub_context** (`Function`)
- 📝 Create a sub-context with a different default source.
- ƒ **execute** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **backend.src.api.auth** (`Module`)
- 📝 Authentication API endpoints.
- 🏗️ Layer: API
@@ -1534,6 +1655,8 @@
- 🔒 Invariant: All settings changes must be persisted via ConfigManager.
- 🔗 DEPENDS_ON -> `ConfigManager`
- 🔗 DEPENDS_ON -> `ConfigModels`
- ℂ **LoggingConfigResponse** (`Class`)
- 📝 Response model for logging configuration with current task log level.
- ƒ **get_settings** (`Function`)
- 📝 Retrieves all application settings.
- ƒ **update_global_settings** (`Function`)
@@ -1552,6 +1675,10 @@
- 📝 Deletes a Superset environment.
- ƒ **test_environment_connection** (`Function`)
- 📝 Tests the connection to a Superset environment.
- ƒ **get_logging_config** (`Function`)
- 📝 Retrieves current logging configuration.
- ƒ **update_logging_config** (`Function`)
- 📝 Updates logging configuration.
- 📦 **backend.src.api.routes.admin** (`Module`)
- 📝 Admin API endpoints for user and role management.
- 🏗️ Layer: API
@@ -1642,8 +1769,12 @@
- 📝 Retrieve a list of tasks with pagination and optional status filter.
- ƒ **get_task** (`Function`)
- 📝 Retrieve the details of a specific task.
- ƒ **get_task_logs** (`Function`)
- 📝 Retrieve logs for a specific task.
- ƒ **get_task_logs** (`Function`) `[CRITICAL]`
- 📝 Retrieve logs for a specific task with optional filtering.
- ƒ **get_task_log_stats** (`Function`)
- 📝 Get statistics about logs for a task (counts by level and source).
- ƒ **get_task_log_sources** (`Function`)
- 📝 Get unique sources for a task's logs.
- ƒ **resolve_task** (`Function`)
- 📝 Resolve a task that is awaiting mapping.
- ƒ **resume_task** (`Function`)
@@ -1659,22 +1790,32 @@
- 📝 SQLAlchemy model for dashboard validation history.
- ƒ **generate_uuid** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **GitModels** (`Module`)
- 📦 **GitModels** (`Module`) `[TRIVIAL]`
- 📝 Git-specific SQLAlchemy models for configuration and repository tracking.
- 🏗️ Layer: Model
- 📦 **backend.src.models.task** (`Module`)
- ℂ **GitServerConfig** (`Class`) `[TRIVIAL]`
- 📝 Configuration for a Git server connection.
- ℂ **GitRepository** (`Class`) `[TRIVIAL]`
- 📝 Tracking for a local Git repository linked to a dashboard.
- ℂ **DeploymentEnvironment** (`Class`) `[TRIVIAL]`
- 📝 Target Superset environments for dashboard deployment.
- 📦 **backend.src.models.task** (`Module`) `[TRIVIAL]`
- 📝 Defines the database schema for task execution records.
- 🏗️ Layer: Domain
- 🔒 Invariant: All primary keys are UUID strings.
- 🔗 DEPENDS_ON -> `sqlalchemy`
- ℂ **TaskRecord** (`Class`)
- ℂ **TaskRecord** (`Class`) `[TRIVIAL]`
- 📝 Represents a persistent record of a task execution.
- 📦 **backend.src.models.connection** (`Module`)
- ℂ **TaskLogRecord** (`Class`) `[CRITICAL]`
- 📝 Represents a single persistent log entry for a task.
- 🔒 Invariant: Each log entry belongs to exactly one task.
- 🔗 DEPENDS_ON -> `TaskRecord`
- 📦 **backend.src.models.connection** (`Module`) `[TRIVIAL]`
- 📝 Defines the database schema for external database connection configurations.
- 🏗️ Layer: Domain
- 🔒 Invariant: All primary keys are UUID strings.
- 🔗 DEPENDS_ON -> `sqlalchemy`
- ℂ **ConnectionConfig** (`Class`)
- ℂ **ConnectionConfig** (`Class`) `[TRIVIAL]`
- 📝 Stores credentials for external databases used for column mapping.
- 📦 **backend.src.models.mapping** (`Module`)
- 📝 Defines the database schema for environment metadata and database mappings using SQLAlchemy.
@@ -1687,14 +1828,17 @@
- 📝 Represents a Superset instance environment.
- ℂ **DatabaseMapping** (`Class`)
- 📝 Represents a mapping between source and target databases.
- ℂ **MigrationJob** (`Class`)
- ℂ **MigrationJob** (`Class`) `[TRIVIAL]`
- 📝 Represents a single migration execution job.
- ℂ **FileCategory** (`Class`)
- 📝 Enumeration of supported file categories in the storage system.
- ℂ **StorageConfig** (`Class`)
- 📝 Configuration model for the storage system, defining paths and naming patterns.
- ℂ **StoredFile** (`Class`)
- 📝 Data model representing metadata for a file stored in the system.
- 📦 **backend.src.models.storage** (`Module`) `[TRIVIAL]`
- 📝 Data models for the storage system.
- 🏗️ Layer: Domain
- ℂ **FileCategory** (`Class`) `[TRIVIAL]`
- 📝 Enumeration of supported file categories in the storage system.
- ℂ **StorageConfig** (`Class`) `[TRIVIAL]`
- 📝 Configuration model for the storage system, defining paths and naming patterns.
- ℂ **StoredFile** (`Class`) `[TRIVIAL]`
- 📝 Data model representing metadata for a file stored in the system.
- 📦 **backend.src.models.dashboard** (`Module`)
- 📝 Defines data models for dashboard metadata and selection.
- 🏗️ Layer: Model
@@ -1726,11 +1870,19 @@
- 🏗️ Layer: Domain
- 🔗 DEPENDS_ON -> `backend.src.core.database`
- 🔗 DEPENDS_ON -> `backend.src.models.llm`
- ℂ **EncryptionManager** (`Class`)
- ℂ **EncryptionManager** (`Class`) `[CRITICAL]`
- 📝 Handles encryption and decryption of sensitive data like API keys.
- 🔒 Invariant: Uses a secret key from environment or a default one (fallback only for dev).
- ƒ **EncryptionManager.__init__** (`Function`)
- 📝 Initialize the encryption manager with a Fernet key.
- ƒ **EncryptionManager.encrypt** (`Function`)
- 📝 Encrypt a plaintext string.
- ƒ **EncryptionManager.decrypt** (`Function`)
- 📝 Decrypt an encrypted string.
- ℂ **LLMProviderService** (`Class`)
- 📝 Service to manage LLM provider lifecycle.
- ƒ **LLMProviderService.__init__** (`Function`)
- 📝 Initialize the service with database session.
- ƒ **get_all_providers** (`Function`)
- 📝 Returns all configured LLM providers.
- ƒ **get_provider** (`Function`)
@@ -1834,7 +1986,7 @@
- ƒ **get_schema** (`Function`)
- 📝 Returns the JSON schema for backup plugin parameters.
- ƒ **execute** (`Function`)
- 📝 Executes the dashboard backup logic.
- 📝 Executes the dashboard backup logic with TaskContext support.
- 📦 **DebugPluginModule** (`Module`)
- 📝 Implements a plugin for system diagnostics and debugging Superset API responses.
- 🏗️ Layer: Plugins
@@ -1853,7 +2005,7 @@
- ƒ **get_schema** (`Function`)
- 📝 Returns the JSON schema for the debug plugin parameters.
- ƒ **execute** (`Function`)
- 📝 Executes the debug logic.
- 📝 Executes the debug logic with TaskContext support.
- ƒ **_test_db_api** (`Function`)
- 📝 Tests database API connectivity for source and target environments.
- ƒ **_get_dataset_structure** (`Function`)
@@ -1876,7 +2028,7 @@
- ƒ **get_schema** (`Function`)
- 📝 Returns the JSON schema for the search plugin parameters.
- ƒ **execute** (`Function`)
- 📝 Executes the dataset search logic.
- 📝 Executes the dataset search logic with TaskContext support.
- ƒ **_get_context** (`Function`)
- 📝 Extracts a small context around the match for display.
- 📦 **MapperPluginModule** (`Module`)
@@ -1897,7 +2049,7 @@
- ƒ **get_schema** (`Function`)
- 📝 Returns the JSON schema for the mapper plugin parameters.
- ƒ **execute** (`Function`)
- 📝 Executes the dataset mapping logic.
- 📝 Executes the dataset mapping logic with TaskContext support.
- 📦 **backend.src.plugins.git_plugin** (`Module`)
- 📝 Предоставляет плагин для версионирования и развертывания дашбордов Superset.
- 🏗️ Layer: Plugin
@@ -1921,7 +2073,7 @@
- ƒ **initialize** (`Function`)
- 📝 Выполняет начальную настройку плагина.
- ƒ **execute** (`Function`)
- 📝 Основной метод выполнения задач плагина.
- 📝 Основной метод выполнения задач плагина с поддержкой TaskContext.
- 🔗 CALLS -> `self._handle_sync`
- 🔗 CALLS -> `self._handle_deploy`
- ƒ **_handle_sync** (`Function`)
@@ -1954,18 +2106,18 @@
- ƒ **get_schema** (`Function`)
- 📝 Returns the JSON schema for migration plugin parameters.
- ƒ **execute** (`Function`)
- 📝 Executes the dashboard migration logic.
- 📝 Executes the dashboard migration logic with TaskContext support.
- 📦 **MigrationPlugin.execute** (`Action`)
- 📝 Execute the migration logic with proper task logging.
- ƒ **schedule_dashboard_validation** (`Function`)
- 📝 Schedules a recurring dashboard validation task.
- ƒ **_parse_cron** (`Function`)
- 📝 Basic cron parser placeholder.
- 📦 **scheduler** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for backend/src/plugins/llm_analysis/scheduler.py
- 🏗️ Layer: Unknown
- ƒ **job_func** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **_parse_cron** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ℂ **LLMProviderType** (`Class`)
- 📝 Enum for supported LLM providers.
- ℂ **LLMProviderConfig** (`Class`)
@@ -1976,13 +2128,19 @@
- 📝 Model for a single issue detected during validation.
- ℂ **ValidationResult** (`Class`)
- 📝 Model for dashboard validation result.
- 📦 **backend.src.plugins.llm_analysis.plugin** (`Module`)
- 📝 Implements DashboardValidationPlugin and DocumentationPlugin.
- 🏗️ Layer: Domain
- ℂ **DashboardValidationPlugin** (`Class`)
- 📝 Plugin for automated dashboard health analysis using LLMs.
- ℂ **DocumentationPlugin** (`Class`)
- 📝 Plugin for automated dataset documentation using LLMs.
- ℂ **DashboardValidationPlugin** (`Class`)
- 📝 Plugin for automated dashboard health analysis using LLMs.
- 🔗 IMPLEMENTS -> `backend.src.core.plugin_base.PluginBase`
- ƒ **DashboardValidationPlugin.execute** (`Function`)
- 📝 Executes the dashboard validation task with TaskContext support.
- ℂ **DocumentationPlugin** (`Class`)
- 📝 Plugin for automated dataset documentation using LLMs.
- 🔗 IMPLEMENTS -> `backend.src.core.plugin_base.PluginBase`
- ƒ **DocumentationPlugin.execute** (`Function`)
- 📝 Executes the dataset documentation task with TaskContext support.
- 📦 **plugin** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for backend/src/plugins/llm_analysis/plugin.py
- 🏗️ Layer: Unknown
- ƒ **id** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **name** (`Function`) `[TRIVIAL]`
@@ -2007,22 +2165,37 @@
- 📝 Auto-detected function (orphan)
- ƒ **execute** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **backend.src.plugins.llm_analysis.service** (`Module`)
- 📝 Services for LLM interaction and dashboard screenshots.
- 🏗️ Layer: Domain
- 🔗 DEPENDS_ON -> `playwright`
- 🔗 DEPENDS_ON -> `openai`
- 🔗 DEPENDS_ON -> `tenacity`
- ℂ **ScreenshotService** (`Class`)
- 📝 Handles capturing screenshots of Superset dashboards.
- ƒ **capture_dashboard** (`Function`)
- 📝 Captures a screenshot of a dashboard using Playwright.
- ℂ **LLMClient** (`Class`)
- 📝 Wrapper for LLM provider APIs.
- ℂ **ScreenshotService** (`Class`)
- 📝 Handles capturing screenshots of Superset dashboards.
- ƒ **ScreenshotService.__init__** (`Function`)
- 📝 Initializes the ScreenshotService with environment configuration.
- ƒ **ScreenshotService.capture_dashboard** (`Function`)
- 📝 Captures a full-page screenshot of a dashboard using Playwright and CDP.
- ℂ **LLMClient** (`Class`)
- 📝 Wrapper for LLM provider APIs.
- ƒ **LLMClient.__init__** (`Function`)
- 📝 Initializes the LLMClient with provider settings.
- ƒ **LLMClient.get_json_completion** (`Function`)
- 📝 Helper to handle LLM calls with JSON mode and fallback parsing.
- ƒ **LLMClient.analyze_dashboard** (`Function`)
- 📝 Sends dashboard data (screenshot + logs) to LLM for health analysis.
- 📦 **service** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for backend/src/plugins/llm_analysis/service.py
- 🏗️ Layer: Unknown
- ƒ **__init__** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **capture_dashboard** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **switch_tabs** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **__init__** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **_should_retry** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **get_json_completion** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- ƒ **analyze_dashboard** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **StoragePlugin** (`Module`)
- 📝 Provides core filesystem operations for managing backups and repositories.
- 🏗️ Layer: App
@@ -2046,7 +2219,7 @@
- ƒ **get_schema** (`Function`)
- 📝 Returns the JSON schema for storage plugin parameters.
- ƒ **execute** (`Function`)
- 📝 Executes storage-related tasks (placeholder for PluginBase compliance).
- 📝 Executes storage-related tasks with TaskContext support.
- ƒ **get_storage_root** (`Function`)
- 📝 Resolves the absolute path to the storage root.
- ƒ **resolve_path** (`Function`)
@@ -2074,12 +2247,73 @@
- 📝 Auto-detected function (orphan)
- ƒ **test_environment_model** (`Function`)
- 📝 Tests that Environment model correctly stores values.
- ƒ **test_belief_scope_logs_entry_action_exit** (`Function`)
- 📝 Test that belief_scope generates [ID][Entry], [ID][Action], and [ID][Exit] logs.
- 📦 **test_task_logger** (`Module`)
- 📝 Unit tests for TaskLogger and TaskContext.
- 🏗️ Layer: Test
- ℂ **TestTaskLogger** (`Class`)
- 📝 Test suite for TaskLogger.
- ƒ **setup_method** (`Function`)
- 📝 Setup for each test method.
- ƒ **test_init** (`Function`)
- 📝 Test TaskLogger initialization.
- ƒ **test_with_source** (`Function`)
- 📝 Test creating a sub-logger with different source.
- ƒ **test_debug** (`Function`)
- 📝 Test debug log level.
- ƒ **test_info** (`Function`)
- 📝 Test info log level.
- ƒ **test_warning** (`Function`)
- 📝 Test warning log level.
- ƒ **test_error** (`Function`)
- 📝 Test error log level.
- ƒ **test_error_with_metadata** (`Function`)
- 📝 Test error logging with metadata.
- ƒ **test_progress** (`Function`)
- 📝 Test progress logging.
- ƒ **test_progress_clamping** (`Function`)
- 📝 Test progress value clamping (0-100).
- ƒ **test_source_override** (`Function`)
- 📝 Test overriding the default source.
- ƒ **test_sub_logger_source_independence** (`Function`)
- 📝 Test sub-logger independence from parent.
- ℂ **TestTaskContext** (`Class`)
- 📝 Test suite for TaskContext.
- ƒ **setup_method** (`Function`)
- 📝 Setup for each test method.
- ƒ **test_init** (`Function`)
- 📝 Test TaskContext initialization.
- ƒ **test_task_id_property** (`Function`)
- 📝 Test task_id property.
- ƒ **test_logger_property** (`Function`)
- 📝 Test logger property.
- ƒ **test_params_property** (`Function`)
- 📝 Test params property.
- ƒ **test_get_param** (`Function`)
- 📝 Test getting a specific parameter.
- ƒ **test_create_sub_context** (`Function`)
- 📝 Test creating a sub-context with different source.
- ƒ **test_context_logger_delegates_to_task_logger** (`Function`)
- 📝 Test context logger delegates to TaskLogger.
- ƒ **test_sub_context_with_source** (`Function`)
- 📝 Test sub-context logger uses new source.
- ƒ **test_multiple_sub_contexts** (`Function`)
- 📝 Test creating multiple sub-contexts.
- ƒ **test_belief_scope_logs_entry_action_exit_at_debug** (`Function`)
- 📝 Test that belief_scope generates [ID][Entry], [ID][Action], and [ID][Exit] logs at DEBUG level.
- ƒ **test_belief_scope_error_handling** (`Function`)
- 📝 Test that belief_scope logs Coherence:Failed on exception.
- ƒ **test_belief_scope_success_coherence** (`Function`)
- 📝 Test that belief_scope logs Coherence:OK on success.
- ƒ **test_belief_scope_not_visible_at_info** (`Function`)
- 📝 Test that belief_scope Entry/Exit/Coherence logs are NOT visible at INFO level.
- ƒ **test_task_log_level_default** (`Function`)
- 📝 Test that default task log level is INFO.
- ƒ **test_should_log_task_level** (`Function`)
- 📝 Test that should_log_task_level correctly filters log levels.
- ƒ **test_configure_logger_task_log_level** (`Function`)
- 📝 Test that configure_logger updates task_log_level.
- ƒ **test_enable_belief_state_flag** (`Function`)
- 📝 Test that enable_belief_state flag controls belief_scope logging.
- 📦 **test_auth** (`Module`) `[TRIVIAL]`
- 📝 Auto-generated module for backend/tests/test_auth.py
- 🏗️ Layer: Unknown
@@ -2101,3 +2335,34 @@
- 📝 Auto-detected function (orphan)
- ƒ **test_ad_group_mapping** (`Function`) `[TRIVIAL]`
- 📝 Auto-detected function (orphan)
- 📦 **test_log_persistence** (`Module`)
- 📝 Unit tests for TaskLogPersistenceService.
- 🏗️ Layer: Test
- ℂ **TestLogPersistence** (`Class`)
- 📝 Test suite for TaskLogPersistenceService.
- ƒ **setup_class** (`Function`)
- 📝 Setup test database and service instance.
- ƒ **teardown_class** (`Function`)
- 📝 Clean up test database.
- ƒ **setup_method** (`Function`)
- 📝 Setup for each test method.
- ƒ **teardown_method** (`Function`)
- 📝 Cleanup after each test method.
- ƒ **test_add_log_single** (`Function`)
- 📝 Test adding a single log entry.
- ƒ **test_add_log_batch** (`Function`)
- 📝 Test adding multiple log entries in batch.
- ƒ **test_get_logs_by_task_id** (`Function`)
- 📝 Test retrieving logs by task ID.
- ƒ **test_get_logs_with_filters** (`Function`)
- 📝 Test retrieving logs with level and source filters.
- ƒ **test_get_logs_with_pagination** (`Function`)
- 📝 Test retrieving logs with pagination.
- ƒ **test_get_logs_with_search** (`Function`)
- 📝 Test retrieving logs with search query.
- ƒ **test_get_log_stats** (`Function`)
- 📝 Test retrieving log statistics.
- ƒ **test_get_log_sources** (`Function`)
- 📝 Test retrieving unique log sources.
- ƒ **test_delete_logs_by_task_id** (`Function`)
- 📝 Test deleting logs by task ID.