Plugins (#145)

Chaotic mega-merge into main. THINGS WILL PROBABLY BE BROKEN


* chore: Update soccer-scoreboard submodule to merged commit

- Update submodule reference to include manifest.json v2 registry format
- Version updated to 1.0.1

* refactor: Remove test_mode and logo_dir config reading from base SportsCore

- Remove test_mode initialization and usage
- Remove logo_dir reading from mode_config
- Use LogoDownloader defaults directly for logo directories

* chore: Update plugin submodules after removing global properties

- Update basketball-scoreboard submodule (removed global test_mode, live_priority, dynamic_duration, logo_dir)
- Update soccer-scoreboard submodule (removed global test_mode, live_priority, dynamic_duration, logo_dir)

* feat(calendar): Add credentials.json file upload via web interface

- Add API endpoint /api/v3/plugins/calendar/upload-credentials for file upload
- Validate JSON format and Google OAuth structure
- Save file to plugin directory with secure permissions (0o600)
- Backup existing credentials.json before overwriting
- Add file upload widget support for string fields in config forms
- Add frontend handler handleCredentialsUpload() for single file uploads
- Update .gitignore to allow calendar submodule
- Update calendar submodule reference

* fix(web): Improve spacing for nested configuration sections

- Add dynamic margin based on nesting depth (mb-6 for deeply nested sections)
- Increase padding in nested content areas (py-3 to py-4)
- Add extra spacing after nested sections to prevent overlap
- Enhance CSS spacing for nested sections (1.5rem for nested, 2rem for deeply nested)
- Add padding-bottom to expanded nested content to prevent cutoff
- Fixes issue where game_limits and other nested settings were hidden under next section header

* chore(plugins): Update sports scoreboard plugins with live update interval fix

- Updated hockey-scoreboard, football-scoreboard, basketball-scoreboard, and soccer-scoreboard submodules
- All plugins now fix the interval selection bug that caused live games to update every 5 minutes instead of 30 seconds
- Ensures all live games update at the configured live_update_interval (30s) for timely score updates

* fix: Initialize test_mode in SportsLive and fix config migration

- Add test_mode initialization in SportsLive.__init__() to prevent AttributeError
- Remove invalid new_secrets parameter from save_config_atomic() call in config migration
- Fixes errors: 'NBALiveManager' object has no attribute 'test_mode'
- Fixes errors: ConfigManager.save_config_atomic() got unexpected keyword argument 'new_secrets'

* chore: Update submodules with test_mode initialization fixes

- Update basketball-scoreboard submodule
- Update soccer-scoreboard submodule

* fix(plugins): Auto-stash local changes before plugin updates

- Automatically stash uncommitted changes before git pull during plugin updates
- Prevents update failures when plugins have local modifications
- Improves error messages for git update failures
- Matches behavior of main LEDMatrix update process

* fix(basketball-scoreboard): Update submodule with timeout fix

- Updated basketball-scoreboard plugin to fix update() timeout issue
- Plugin now uses fire-and-forget odds fetching for upcoming games
- Prevents 30-second timeout when processing many upcoming games

Also fixed permission issue on devpi:
- Changed /var/cache/ledmatrix/display_on_demand_state.json permissions
  from 600 to 660 to allow web service (devpi user) to read the file

* fix(cache): Ensure cache files use 660 permissions for group access

- Updated setup_cache.sh to set file permissions to 660 (not 775)
- Updated first_time_install.sh to properly set cache file permissions
- Modified DiskCache to set 660 permissions when creating cache files
- Ensures display_on_demand_state.json and other cache files are readable
  by web service (devpi user) which is in ledmatrix group

This fixes permission issues where cache files were created with 600
permissions, preventing the web service from reading them. Now files
are created with 660 (rw-rw----) allowing group read access.

* fix(soccer-scoreboard): Update submodule with manifest fix

- Updated soccer-scoreboard plugin submodule
- Added missing entry_point and class_name to manifest.json
- Fixes plugin loading error: 'No class_name in manifest'

Also fixed cache file permissions on devpi server:
- Changed display_on_demand_state.json from 600 to 660 permissions
- Allows web service (devpi user) to read cache files

* fix(display): Remove update_display() calls from clear() to prevent black flash

Previously, display_manager.clear() was calling update_display() twice,
which immediately showed a black screen on the hardware before new
content could be drawn. This caused visible black flashes when switching
between modes, especially when plugins switch from general modes (e.g.,
football_upcoming) to specific sub-modes (e.g., nfl_upcoming).

Now clear() only prepares the buffer without updating the hardware.
Callers can decide when to update the display, allowing smooth transitions
from clear → draw → update_display() without intermediate black flashes.

Places that intentionally show a cleared screen (error cases) already
explicitly call update_display() after clear(), so backward compatibility
is maintained.

* fix(scroll): Prevent wrap-around before cycle completion in dynamic duration

- Check scroll completion BEFORE allowing wrap-around
- Clamp scroll_position when complete to prevent visual loop
- Only wrap-around if cycle is not complete yet
- Fixes issue where stocks plugin showed first stock again at end
- Completion logged only once to avoid spam
- Ensures smooth transition to next mode without visual repeat

* fix(on-demand): Ensure on-demand buttons work and display service runs correctly

- Add early stub functions for on-demand modal to ensure availability when Alpine.js initializes
- Increase on-demand request cache max_age from 5min to 1hr to prevent premature expiration
- Fixes issue where on-demand buttons were not functional due to timing issues
- Ensures display service properly picks up on-demand requests when started

* test: Add comprehensive test coverage (30%+)

- Add 100+ new tests across core components
- Add tests for LayoutManager (27 tests)
- Add tests for PluginLoader (14 tests)
- Add tests for SchemaManager (20 tests)
- Add tests for MemoryCache and DiskCache (24 tests)
- Add tests for TextHelper (9 tests)
- Expand error handling tests (7 new tests)
- Improve coverage from 25.63% to 30.26%
- All 237 tests passing

Test files added:
- test/test_layout_manager.py
- test/test_plugin_loader.py
- test/test_schema_manager.py
- test/test_text_helper.py
- test/test_config_service.py
- test/test_display_controller.py
- test/test_display_manager.py
- test/test_error_handling.py
- test/test_font_manager.py
- test/test_plugin_system.py

Updated:
- pytest.ini: Enable coverage reporting with 30% threshold
- test/conftest.py: Enhanced fixtures for better test isolation
- test/test_cache_manager.py: Expanded cache component tests
- test/test_config_manager.py: Additional config tests

Documentation:
- HOW_TO_RUN_TESTS.md: Guide for running and understanding tests

* test(web): Add comprehensive API endpoint tests

- Add 30 new tests for Flask API endpoints in test/test_web_api.py
- Cover config, system, display, plugins, fonts, and error handling APIs
- Increase test coverage from 30.26% to 30.87%
- All 267 tests passing

Tests cover:
- Config API: GET/POST main config, schedule, secrets
- System API: Status, version, system actions
- Display API: Current display, on-demand start/stop
- Plugins API: Installed plugins, health, config, operations, state
- Fonts API: Catalog, tokens, overrides
- Error handling: Invalid JSON, missing fields, 404s

* test(plugins): Add comprehensive integration tests for all plugins

- Add base test class for plugin integration tests
- Create integration tests for all 6 plugins:
  - basketball-scoreboard (11 tests)
  - calendar (10 tests)
  - clock-simple (11 tests)
  - odds-ticker (9 tests)
  - soccer-scoreboard (11 tests)
  - text-display (12 tests)
- Total: 64 new plugin integration tests
- Increase test coverage from 30.87% to 33.38%
- All 331 tests passing

Tests verify:
- Plugin loading and instantiation
- Required methods (update, display)
- Manifest validation
- Display modes
- Config schema validation
- Graceful handling of missing API credentials

Uses hybrid approach: integration tests in main repo,
plugin-specific unit tests remain in plugin submodules.

* Add mqtt-notifications plugin as submodule

* fix(sports): Respect games_to_show settings for favorite teams

- Fix upcoming games to show N games per team (not just 1)
- Fix recent games to show N games per team (not just 1)
- Add duplicate removal for games involving multiple favorite teams
- Match behavior of basketball-scoreboard plugin
- Affects NFL, NHL, and other sports using base_classes/sports.py

* chore: Remove debug instrumentation logs

- Remove temporary debug logging added during fix verification
- Fix confirmed working by user

* debug: Add instrumentation to debug configuration header visibility issue

* fix: Resolve nested section content sliding under next header

- Remove overflow-hidden from nested-section to allow proper document flow
- Add proper z-index and positioning to prevent overlap
- Add margin-top to nested sections for better spacing
- Remove debug instrumentation that was causing ERR_BLOCKED_BY_CLIENT errors

* fix: Prevent unnecessary plugin tab redraws

- Add check to only update tabs when plugin list actually changes
- Increase debounce timeout to batch rapid changes
- Compare plugin IDs before updating to avoid redundant redraws
- Fix setter to check for actual changes before triggering updates

* fix: Prevent form-groups from sliding out of view when nested sections expand

- Increase margin-bottom on nested-sections for better spacing
- Add clear: both to nested-sections to ensure proper document flow
- Change overflow to visible when expanded to allow natural flow
- Add margin-bottom to expanded content
- Add spacing rules for form-groups that follow nested sections
- Add clear spacer div after nested sections

* fix: Reduce excessive debug logging in generateConfigForm

- Only log once per plugin instead of on every function call
- Prevents log spam when Alpine.js re-renders the form multiple times
- Reduces console noise from 10+ logs per plugin to 1 log per plugin

* fix: Prevent nested section content from sliding out of view when expanded

- Remove overflow-hidden from nested-section in base.html (was causing clipping)
- Add scrollIntoView to scroll expanded sections into view within modal
- Set nested-section overflow to visible to prevent content clipping
- Add min-height to nested-content to ensure proper rendering
- Wait for animation to complete before scrolling into view

* fix: Prevent form-groups from overlapping and appearing outside view

- Change nested-section overflow to hidden by default, visible when expanded
- Add :has() selector to allow overflow when content is expanded
- Ensure form-groups after nested sections have proper spacing and positioning
- Add clear: both and width: 100% to prevent overlap
- Use !important for margin-top to ensure spacing is applied
- Ensure form-groups are in normal document flow with float: none

* fix: Use JavaScript to toggle overflow instead of :has() selector

- :has() selector may not be supported in all browsers
- Use JavaScript to set overflow: visible when expanded, hidden when collapsed
- This ensures better browser compatibility while maintaining functionality

* fix: Make parent sections expand when nested sections expand

- Add updateParentNestedContentHeight() helper to recursively update parent heights
- When a nested section expands, recalculate all parent nested-content max-heights
- Ensures parent sections (like NFL) expand to accommodate expanded child sections
- Updates parent heights both on expand and collapse for proper animation

* refactor: Simplify parent section expansion using CSS max-height: none

- Remove complex recursive parent height update function
- Use CSS max-height: none when expanded to allow natural expansion
- Parent sections automatically expand because nested-content has no height constraint
- Simpler and more maintainable solution

* refactor: Remove complex recursive parent height update function

- CSS max-height: none already handles parent expansion automatically
- No need for JavaScript to manually update parent heights
- Much simpler and cleaner solution

* debug: Add instrumentation to debug auto-collapse issue

- Add logging to track toggle calls and state changes
- Add guard to prevent multiple simultaneous toggles
- Pass event object to prevent bubbling
- Improve state detection logic
- Add return false to onclick handlers

* chore: Remove debug instrumentation from toggleNestedSection

- Remove all debug logging code
- Keep functional fixes: event handling, toggle guard, improved state detection
- Code is now clean and production-ready

* fix(web): Add browser refresh note to plugin fetch errors

* refactor(text-display): Update submodule to use ScrollHelper

* fix(text-display): Fix scrolling display issue - update position in display()

* feat(text-display): Add scroll_loop option and improve scroll speed control

* debug: Add instrumentation to track plugin enabled state changes

Added debug logging to investigate why plugins appear to disable themselves:
- Track enabled state during plugin load (before/after schema merge)
- Track enabled state during plugin reload
- Track enabled state preservation during config save
- Track state reconciliation fixes
- Track enabled state updates in on_config_change

This will help identify which code path is causing plugins to disable.

* debug: Fix debug log path to work on Pi

Changed hardcoded log path to use dynamic project root detection:
- Uses LEDMATRIX_ROOT env var if set
- Falls back to detecting project root by looking for config directory
- Creates .cursor directory if it doesn't exist
- Falls back to /tmp/ledmatrix_debug.log if all else fails
- Added better error handling with logger fallback

* Remove debug instrumentation for plugin enabled state tracking

Removed all debug logging that was added to track plugin enabled state changes.
The instrumentation has been removed as requested.

* Reorganize documentation and cleanup test files

- Move documentation files to docs/ directory
- Remove obsolete test files
- Update .gitignore and README

* feat(text-display): Switch to frame-based scrolling with high FPS support

* fix(text-display): Add backward compatibility for ScrollHelper sub-pixel scrolling

* feat(scroll_helper): Add sub-pixel scrolling support for smooth movement

- Add sub-pixel interpolation using scipy (if available) or numpy fallback
- Add set_sub_pixel_scrolling() method to enable/disable feature
- Implement _get_visible_portion_subpixel() for fractional pixel positioning
- Implement _interpolate_subpixel() for linear interpolation
- Prevents pixel skipping at slow scroll speeds
- Maintains backward compatibility with integer pixel path

* fix(scroll_helper): Reset last_update_time in reset_scroll() to prevent jump-ahead

- Reset last_update_time when resetting scroll position
- Prevents large delta_time on next update after reset
- Fixes issue where scroll would immediately complete again after reset
- Ensures smooth scrolling continuation after loop reset

* fix(scroll_helper): Fix numpy broadcasting error in sub-pixel interpolation

- Add output_width parameter to _interpolate_subpixel() for variable widths
- Fix wrap-around case to use correct widths for interpolation
- Handle edge cases where source array is smaller than expected
- Prevent 'could not broadcast input array' errors in sub-pixel scrolling
- Ensure proper width matching in all interpolation paths

* feat(scroll): Add frame-based scrolling mode for smooth LED matrix movement

- Add frame_based_scrolling flag to ScrollHelper
- When enabled, moves fixed pixels per step, throttled by scroll_delay
- Eliminates time-based jitter by ignoring frame timing variations
- Provides stock-ticker-like smooth, predictable scrolling
- Update text-display plugin to use frame-based mode

This addresses stuttering issues where time-based scrolling caused
visual jitter due to frame timing variations in the main display loop.

* fix(scroll): Fix NumPy broadcasting errors in sub-pixel wrap-around

- Ensure _interpolate_subpixel always returns exactly requested width
- Handle cases where scipy.ndimage.shift produces smaller arrays
- Add padding logic for wrap-around cases when arrays are smaller than expected
- Prevents 'could not broadcast input array' errors during scrolling

* refactor(scroll): Remove sub-pixel interpolation, use high FPS integer scrolling

- Disable sub-pixel scrolling by default in ScrollHelper
- Simplify get_visible_portion to always use integer pixel positioning
- Restore frame-based scrolling logic for smooth high FPS movement
- Use high frame rate (like stock ticker) for smoothness instead of interpolation
- Reduces complexity and eliminates broadcasting errors

* fix(scroll): Prevent large pixel jumps in frame-based scrolling

- Initialize last_step_time properly to prevent huge initial jumps
- Clamp scroll_speed to max 5 pixels/frame in frame-based mode
- Prevents 60-pixel jumps when scroll_speed is misconfigured
- Simplified step calculation to avoid lag catch-up jumps

* fix(text-display): Align config schema and add validation

- Update submodule reference
- Adds warning and logging for scroll_speed config issues

* fix(scroll): Simplify frame-based scrolling to match stock ticker behavior

- Remove throttling logic from frame-based scrolling
- Move pixels every call (DisplayController's loop timing controls rate)
- Add enable_scrolling attribute to text-display plugin for high-FPS treatment
- Matches stock ticker: simple, predictable movement every frame
- Eliminates jitter from timing mismatches between DisplayController and ScrollHelper

* fix(scroll): Restore scroll_delay throttling in frame-based mode

- Restore time-based throttling using scroll_delay
- Move pixels only when scroll_delay has passed
- Handle lag catch-up with reasonable caps to prevent huge jumps
- Preserve fractional timing for smooth operation
- Now scroll_delay actually controls the scroll speed as intended

* feat(text-display): Add FPS counter logging

- Update submodule reference
- Adds FPS tracking and logging every 5 seconds

* fix(text-display): Add display-width buffer so text scrolls completely off

- Update submodule reference
- Adds end buffer to ensure text exits viewport before looping

* fix: Prevent premature game switching in SportsLive

- Set last_game_switch when games load even if current_game already exists
- Set last_game_switch when same games update but it's still 0
- Add guard to prevent switching check when last_game_switch is 0
- Fixes issue where first game shows for only ~2 seconds before switching
- Also fixes random screen flickering when games change prematurely

* feat(plugins): Add branch selection support for plugin installation

- Add optional branch parameter to install_plugin() and install_from_url() in store_manager
- Update API endpoints to accept and pass branch parameter
- Update frontend JavaScript to support branch selection in install calls
- Maintain backward compatibility - branch parameter is optional everywhere
- Falls back to default branch logic if specified branch doesn't exist

* feat(plugins): Add UI for branch selection in plugin installation

- Add branch input field in 'Install Single Plugin' section
- Add global branch input for store installations
- Update JavaScript to read branch from input fields
- Branch input applies to all store installations when specified

* feat(plugins): Change branch selection to be per-plugin instead of global

- Remove global store branch input field
- Add individual branch input field to each plugin card in store
- Add branch input to custom registry plugin cards
- Each plugin can now have its own branch specified independently

* debug: Add logging to _should_exit_dynamic

* feat(display_controller): Add universal get_cycle_duration support for all plugins

UNIVERSAL FEATURE: Any plugin can now implement get_cycle_duration() to dynamically
calculate the total time needed to show all content for a mode.

New method:
- _plugin_cycle_duration(plugin, display_mode): Queries plugin for calculated duration

Integration:
- Display controller calls plugin.get_cycle_duration(display_mode)
- Uses returned duration as target (respecting max cap)
- Falls back to cap if not provided

Benefits:
- Football plugin: Show all games (3 games × 15s = 45s total)
- Basketball plugin: Could implement same logic
- Hockey/Baseball/any sport: Universal support
- Stock ticker: Could calculate based on number of stocks
- Weather: Could calculate based on forecast days

Example plugin implementation:

Result: Plugins control their own display duration based on actual content,
creating a smooth user experience where all content is shown before switching.

* debug: Add logging to cycle duration call

* debug: Change loop exit logs to INFO level

* fix: Change cycle duration logs to INFO level

* fix: Don't exit loop on False for dynamic duration plugins

For plugins with dynamic duration enabled, keep the display loop running
even when display() returns False. This allows games to continue rotating
within the calculated duration.

The loop will only exit when:
- Cycle is complete (plugin reports all content shown)
- Max duration is reached
- Mode is changed externally

* fix(schedule): Improve display scheduling functionality

- Add GET endpoint for schedule configuration retrieval
- Fix mode switching to clean up old config keys (days/start_time/end_time)
- Improve error handling with consistent error_response() usage
- Enhance display controller schedule checking with better edge case handling
- Add validation for time formats and ensure at least one day enabled in per-day mode
- Add debug logging for schedule state changes

Fixes issues where schedule mode switching left stale config causing incorrect behavior.

* fix(install): Add cmake and ninja-build to system dependencies

Resolves h3 package build failure during first-time installation.
The h3 package (dependency of timezonefinder) requires CMake and
Ninja to build from source. Adding these build tools ensures
successful installation of all Python dependencies.

* fix: Pass display_mode in ALL loop calls to maintain sticky manager

CRITICAL FIX: Display controller was only passing display_mode on first call,
causing plugins to fall back to internal mode cycling and bypass sticky
manager logic.

Now consistently passes display_mode=active_mode on every display() call in
both high-FPS and normal loops. This ensures plugins maintain mode context
and sticky manager state throughout the entire display duration.

* feat(install): Add OS check for Raspberry Pi OS Lite (Trixie)

- Verify OS is Raspberry Pi OS (raspbian/debian)
- Require Debian 13 (Trixie) specifically
- Check for Lite version (no desktop environment)
- Exit with clear error message if requirements not met
- Provide instructions for obtaining correct OS version

* fix(web-ui): Add missing notification handlers to quick action buttons

- Added hx-on:htmx:after-request handlers to all quick action buttons in overview.html
- Added hx-ext='json-enc' for proper JSON encoding
- Added missing notification handler for reboot button in index.html
- Users will now see toast notifications when actions complete or fail

* fix(display): Ensure consistent display mode handling in all plugin calls

- Updated display controller to consistently pass display_mode in all plugin display() calls.
- This change maintains the sticky manager state and ensures plugins retain their mode context throughout the display duration.
- Addresses issues with mode cycling and improves overall display reliability.

* fix(display): Enhance display mode persistence across plugin updates

- Updated display controller to ensure display_mode is consistently maintained during plugin updates.
- This change prevents unintended mode resets and improves the reliability of display transitions.
- Addresses issues with mode persistence, ensuring a smoother user experience across all plugins.

* feat: Add Olympics countdown plugin as submodule

- Add olympics-countdown plugin submodule
- Update .gitignore to allow olympics-countdown plugin
- Plugin automatically determines next Olympics and counts down to opening/closing ceremonies

* feat(web-ui): Add checkbox-group widget support for multi-select arrays

- Add checkbox-group widget rendering in plugins_manager.js
- Update form processing to handle checkbox groups with [] naming
- Support for friendly labels via x-options in config schemas
- Update odds-ticker submodule with checkbox-group implementation

* fix(plugins): Preserve enabled state when saving plugin config from main config endpoint

When saving plugin configuration through save_main_config endpoint, the enabled
field was not preserved if missing from the form data. This caused plugins to
be automatically disabled when users saved their configuration from the plugin
manager tab.

This fix adds the same enabled state preservation logic that exists in
save_plugin_config endpoint, ensuring consistent behavior across both endpoints.
The enabled state is preserved from current config, plugin instance, or defaults
to True to prevent unexpected disabling of plugins.

* fix(git): Resolve git status timeout and exclude plugins from base project updates

- Add --untracked-files=no flag to git status for faster execution
- Increase timeout from 5s to 30s for git status operations
- Add timeout exception handling for git status and stash operations
- Filter out plugins directory from git status checks (plugins are separate repos)
- Exclude plugins from stash operations using :!plugins pathspec
- Apply same fixes to plugin store manager update operations

* feat(plugins): Add granular scroll speed control to odds-ticker and leaderboard plugins

- Add display object to both plugins' config schemas with scroll_speed and scroll_delay
- Enable frame-based scrolling mode for precise FPS control (100 FPS for leaderboard)
- Add set_scroll_speed() and set_scroll_delay() methods to both plugins
- Maintain backward compatibility with scroll_pixels_per_second config
- Leaderboard plugin now explicitly sets target_fps to 100 for high-performance scrolling

* fix(scroll): Correct dynamic duration calculation for frame-based scrolling

- Fix calculate_dynamic_duration() to properly handle frame-based scrolling mode
- Convert scroll_speed from pixels/frame to pixels/second when in frame-based mode
- Prevents incorrect duration calculations (e.g., 2609s instead of 52s)
- Affects all plugins using ScrollHelper: odds-ticker, leaderboard, stocks, text-display
- Add debug logging to show scroll mode and effective speed

* Remove version logic from plugin system, use git commits instead

- Remove version parameter from install_plugin() method
- Rename fetch_latest_versions to fetch_commit_info throughout codebase
- Remove version fields from plugins.json registry (versions, latest_version, download_url_template)
- Remove version logging from plugin manager
- Update web UI to use fetch_commit_info parameter
- Update .gitignore to ignore all plugin folders (remove whitelist exceptions)
- Remove plugin directories from git index (plugins now installed via plugin store only)

Plugins now always install latest commit from default branch. Version fields
replaced with git commit SHA and commit dates. System uses git-based approach
for all plugin metadata.

* feat(plugins): Normalize all plugins as git submodules

- Convert all 18 plugins to git submodules for uniform management
- Add submodules for: baseball-scoreboard, christmas-countdown, football-scoreboard, hockey-scoreboard, ledmatrix-flights, ledmatrix-leaderboard, ledmatrix-music, ledmatrix-stocks, ledmatrix-weather, static-image
- Re-initialize mqtt-notifications as proper submodule
- Update .gitignore to allow all plugin submodules
- Add normalize_plugin_submodules.sh script for future plugin management

All plugins with GitHub repositories are now managed as git submodules,
ensuring consistent version control and easier updates.

* refactor(repository): Reorganize scripts and files into organized directory structure

- Move installation scripts to scripts/install/ (except first_time_install.sh)
- Move development scripts to scripts/dev/
- Move utility scripts to scripts/utils/
- Move systemd service files to systemd/
- Keep first_time_install.sh, start_display.sh, stop_display.sh in root
- Update all path references in scripts, documentation, and service files
- Add README.md files to new directories explaining their purpose
- Remove empty tools/ directory (contents moved to scripts/dev/)
- Add .gitkeep to data/ directory

* fix(scripts): Fix PROJECT_DIR path in start_web_conditionally.py after move to scripts/utils/

* fix(scripts): Fix PROJECT_DIR/PROJECT_ROOT path resolution in moved scripts

- Fix wifi_monitor_daemon.py to use project root instead of scripts/utils/
- Fix shell scripts in scripts/ to correctly resolve project root (go up one more level)
- Fix scripts in scripts/fix_perms/ to correctly resolve project root
- Update diagnose_web_interface.sh to reference moved start_web_conditionally.py path

All scripts now correctly determine project root after reorganization.

* fix(install): Update first_time_install.sh to detect and update service files with old paths

- Check for old paths in service files and reinstall if needed
- Always reinstall main service (install_service.sh is idempotent)
- This ensures existing installations get updated paths after reorganization

* fix(install): Update install_service.sh message to indicate it updates existing services

* fix(wifi): Enable WiFi scan to work when AP mode is active

- Temporarily disable AP mode during network scanning
- Automatically re-enable AP mode after scan completes
- Add proper error handling with try/finally to ensure AP mode restoration
- Add user notification when AP mode is temporarily disabled
- Improve error messages for common scanning failures
- Add timing delays for interface mode switching

* fix(wifi): Fix network parsing to handle frequency with 'MHz' suffix

- Strip 'MHz' suffix from frequency field before float conversion
- Add better error logging for parsing failures
- Fixes issue where all networks were silently skipped due to ValueError

* debug(wifi): Add console logging and Alpine.js reactivity fixes for network display

- Add console.log statements to debug network scanning
- Add x-effect to force Alpine.js reactivity updates
- Add unique keys to x-for template
- Add debug display showing network count
- Improve error handling and user feedback

* fix(wifi): Manually update select options instead of using Alpine.js x-for

- Replace Alpine.js x-for template with manual DOM manipulation
- Add updateSelectOptions() method to directly update select dropdown
- This fixes issue where networks weren't appearing in dropdown
- Alpine.js x-for inside select elements can be unreliable

* feat(web-ui): Add patternProperties support for dynamic key-value pairs

- Add UI support for patternProperties objects (custom_feeds, feed_logo_map)
- Implement key-value pair editor with add/remove functionality
- Add JavaScript functions for managing dynamic key-value pairs
- Update form submission to handle patternProperties JSON data
- Enable easy configuration of feed_logo_map in web UI

* chore: Update ledmatrix-news submodule to latest commit

* fix(plugins): Handle arrays of objects in config normalization

Fix configuration validation failure for static-image plugin by adding
recursive normalization support for arrays of objects. The normalize_config_values
function now properly handles arrays containing objects (like image_config.images)
by recursively normalizing each object in the array using the items schema properties.

This resolves the 'configuration validation failed' error when saving static
image plugin configuration with multiple images.

* fix(plugins): Handle union types in config normalization and form generation

Fix configuration validation for fields with union types like ['integer', 'null'].
The normalization function now properly handles:
- Union types in top-level fields (e.g., random_seed: ['integer', 'null'])
- Union types in array items
- Empty string to None conversion for nullable fields
- Form generation and submission for union types

This resolves validation errors when saving plugin configs with nullable
integer/number fields (e.g., rotation_settings.random_seed in static-image plugin).

Also improves UX by:
- Adding placeholder text for nullable fields explaining empty = use default
- Properly handling empty values in form submission for union types

* fix(plugins): Improve union type normalization with better edge case handling

Enhanced normalization for union types like ['integer', 'null']:
- Better handling of whitespace in string values
- More robust empty string to None conversion
- Fallback to None when conversion fails and null is allowed
- Added debug logging for troubleshooting normalization issues
- Improved handling of nested object fields with union types

This should resolve remaining validation errors for nullable integer/number
fields in nested objects (e.g., rotation_settings.random_seed).

* chore: Add ledmatrix-news plugin to .gitignore exceptions

* Fix web interface service script path in install_service.sh

- Updated ExecStart path from start_web_conditionally.py to scripts/utils/start_web_conditionally.py
- Updated diagnose_web_ui.sh to check for correct script path
- Fixes issue where web UI service fails to start due to incorrect script path

* Fix nested configuration section headers not expanding

Fixed toggleNestedSection function to properly calculate scrollHeight when
expanding nested configuration sections. The issue occurred when sections
started with display:none - the scrollHeight was being measured before the
browser had a chance to lay out the element, resulting in a value of 0.

Changes:
- Added setTimeout to delay scrollHeight measurement until after layout
- Added overflow handling during animations to prevent content jumping
- Added fallback for edge cases where scrollHeight might still be 0
- Set maxHeight to 'none' after expansion completes for natural growth
- Updated function in both base.html and plugins_manager.js

This fix applies to all plugins with nested configuration sections, including:
- Hockey/Football/Basketball/Baseball/Soccer scoreboards (customization, global sections)
- All plugins with transition, display, and other nested configuration objects

Fixes configuration header expansion issues across all plugins.

* Fix syntax error in first_time_install.sh step 8.5

Added missing 'fi' statement to close the if block in the WiFi monitor
service installation section. This resolves the 'unexpected end of file'
error that occurred at line 1385 during step 8.5.

* Fix WiFi UI: Display correct SSID and accurate signal strength

- Fix WiFi network selection dropdown not showing available networks
  - Replace manual DOM manipulation with Alpine.js x-for directive
  - Add fallback watcher to ensure select updates reactively

- Fix WiFi status display showing netplan connection name instead of SSID
  - Query actual SSID from device properties (802-11-wireless.ssid)
  - Add fallback methods to get SSID from active WiFi connection list

- Improve signal strength accuracy
  - Get signal directly from device properties (WIFI.SIGNAL)
  - Add multiple fallback methods for robust signal retrieval
  - Ensure signal percentage is accurate and up-to-date

* Improve WiFi connection UI and error handling

- Fix connect button disabled condition to check both selectedSSID and manualSSID
- Improve error handling to display actual server error messages from 400 responses
- Add step-by-step labels (Step 1, Step 2, Step 3) to clarify connection workflow
- Add visual feedback showing selected network in blue highlight box
- Improve password field labeling with helpful instructions
- Add auto-clear logic between dropdown and manual SSID entry
- Enhance backend validation with better error messages and logging
- Trim SSID whitespace before processing to prevent validation errors

* Add WiFi disconnect functionality for AP mode testing

- Add disconnect_from_network() method to WiFiManager
  - Disconnects from current WiFi network using nmcli
  - Automatically triggers AP mode check if auto_enable_ap_mode is enabled
  - Returns success/error status with descriptive messages

- Add /api/v3/wifi/disconnect API endpoint
  - POST endpoint to disconnect from current WiFi network
  - Includes proper error handling and logging

- Add disconnect button to WiFi status section
  - Only visible when connected to a network
  - Red styling to indicate disconnection action
  - Shows 'Disconnecting...' state during operation
  - Automatically refreshes status after disconnect

- Integrates with AP mode auto-enable functionality
  - When disconnected, automatically enables AP mode if configured
  - Perfect for testing captive portal and AP mode features

* Add explicit handling for broken pipe errors during plugin dependency installation

- Catch BrokenPipeError and OSError (errno 32) explicitly in all dependency installation methods
- Add clear error messages explaining network interruption or buffer overflow causes
- Improves error handling in store_manager, plugin_loader, and plugin_manager
- Helps diagnose 'Errno 32 Broken Pipe' errors during pip install operations

* Add WiFi permissions configuration script and integrate into first-time install

- Create configure_wifi_permissions.sh script
  - Configures passwordless sudo for nmcli commands
  - Configures PolicyKit rules for NetworkManager control
  - Fixes 'Not Authorized to control Networking' error
  - Allows web interface to connect/disconnect WiFi without password prompts

- Integrate WiFi permissions configuration into first_time_install.sh
  - Added as Step 10.1 after passwordless sudo configuration
  - Runs automatically during first-time installation
  - Ensures WiFi management works out of the box

- Resolves authorization errors when connecting/disconnecting WiFi networks
  - NetworkManager requires both sudo and PolicyKit permissions
  - Script configures both automatically for seamless WiFi management

* Add WiFi status LED message display integration

- Integrate WiFi status messages from wifi_manager into display_controller
- WiFi status messages interrupt normal rotation (but respect on-demand)
- Priority: on-demand > wifi-status > live-priority > normal rotation
- Safe implementation with comprehensive error handling
- Automatic cleanup of expired/corrupted status files
- Word-wrapping for long messages (max 2 lines)
- Centered text display with small font
- Non-intrusive: all errors are caught and logged, never crash controller

* Fix display loop issues: reduce log spam and handle missing plugins

- Change _should_exit_dynamic logging from INFO to DEBUG to reduce log spam
  in tight loops (every 8ms) that was causing high CPU usage
- Fix display loop not running when manager_to_display is None
- Add explicit check to set display_result=False when no plugin manager found
- Fix logic bug where manager_to_display was overwritten after circuit breaker skip
- Ensure proper mode rotation when plugins have no content or aren't found

* Add debug logging to diagnose display loop stuck issue

* Change debug logs to INFO level to diagnose display loop stuck

* Add schedule activation logging and ensure display is blanked when inactive

- Add clear INFO-level log message when schedule makes display inactive
- Track previous display state to detect schedule transitions
- Clear display when schedule makes it inactive to ensure blank screen
  (prevents showing initialization screen when schedule kicks in)
- Initialize _was_display_active state tracking in __init__

* Fix indentation errors in schedule state tracking

* Add rotation between hostname and IP address every 10 seconds

- Added _get_local_ip() method to detect device IP address
- Implemented automatic rotation between hostname and IP every 10 seconds
- Enhanced logging to include both hostname and IP in initialization
- Updated get_info() to expose device_ip and current_display_mode

* Add WiFi connection failsafe system

- Save original connection before attempting new connection
- Automatically restore original connection if new connection fails
- Enable AP mode as last resort if restoration fails
- Enhanced connection verification with multiple attempts
- Verify correct SSID (not just 'connected' status)
- Better error handling and exception recovery
- Prevents Pi from becoming unresponsive on connection failure
- Always ensures device remains accessible via original WiFi or AP mode

* feat(web): Improve web UI startup speed and fix cache permissions

- Defer plugin discovery until first API request (removed from startup)
- Add lazy loading to operation queue, state manager, and operation history
- Defer health monitor initialization until first request
- Fix cache directory permission issue:
  - Add systemd CacheDirectory feature for automatic cache dir creation
  - Add manual cache directory creation in install script as fallback
  - Improve cache manager logging (reduce alarming warnings)
- Fix syntax errors in wifi_manager.py (unclosed try blocks)

These changes significantly improve web UI startup time, especially with many
plugins installed, while maintaining full backward compatibility.

* feat(plugins): Improve GitHub token pop-up UX and combine warning/settings

- Fix visibility toggle to handle inline styles properly
- Remove redundant inline styles from HTML elements
- Combine warning banner and settings panel into unified component
- Add loading states to save/load token buttons
- Improve error handling with better user feedback
- Add token format validation (ghp_ or github_pat_ prefix)
- Auto-refresh GitHub auth status after saving token
- Hide warning banner when settings panel opens
- Clear input field after successful save for security

This creates a smoother UX flow where clicking 'Configure Token'
transitions from warning directly to configuration form.

* fix(wifi): Prevent WiFi radio disabling during AP mode disable

- Make NetworkManager restart conditional (only for hostapd mode)
- Add enhanced WiFi radio enable with retry and verification logic
- Add connectivity safety check before NetworkManager restart
- Ensure WiFi radio enabled after all AP mode disable operations
- Fix indentation bug in dnsmasq backup restoration logic
- Add pre-connection WiFi radio check for safety

Fixes issue where WiFi radio was being disabled when disabling AP mode,
especially when connected via Ethernet, making it impossible to enable
WiFi from the web UI.

* fix(plugin-templates): Fix unreachable fallback to expired cache in update() method

The exception handler in update() checked the cached variable, which would
always be None or falsy at that point. If fresh cached data existed, the
method returned early. If cached data was expired, it was filtered out by
max_age constraint. The fix retrieves cached data again in the exception
handler with a very large max_age (1 year) to effectively bypass expiration
check and allow fallback to expired data when fetch fails.

* fix(plugin-templates): Resolve plugin_id mismatch in test template setUp method

* feat(plugins): Standardize manifest version fields schema

- Consolidate version fields to use consistent naming:
  - compatible_versions: array of semver ranges (required)
  - min_ledmatrix_version: string (optional)
  - max_ledmatrix_version: string (optional)
  - versions[].ledmatrix_min_version: renamed from ledmatrix_min
- Add manifest schema validation (schema/manifest_schema.json)
- Update store_manager to validate version fields and schema
- Update template and all documentation examples to use standardized fields
- Add deprecation warnings for ledmatrix_version and ledmatrix_min fields

* fix(templates): Update plugin README template script path to correct location

* docs(plugin): Resolve conflicting version management guidance in .cursorrules

* chore(.gitignore): Consolidate plugin exclusion patterns

Remove unnecessary !plugins/*/.git pattern and consolidate duplicate
negations by keeping only trailing-slash directory exclusions.

* docs: Add language specifiers to code blocks in STATIC_IMAGE_MULTI_UPLOAD_PLAN.md

* fix(templates): Remove api_key from config.json example in plugin README template

Remove api_key field from config.json example to prevent credential leakage.
API keys should only be stored in config_secrets.json. Added clarifying note
about proper credential storage.

* docs(README): Add plugin installation and migration information

- Add plugin installation instructions via web interface and GitHub URL
- Add plugin migration guide for users upgrading from old managers
- Improve plugin documentation for new users

* docs(readme): Update donation links and add Discord acknowledgment

* docs: Add comprehensive API references and consolidate documentation

- Add API_REFERENCE.md with complete REST API documentation (50+ endpoints)
- Add PLUGIN_API_REFERENCE.md documenting Display Manager, Cache Manager, and Plugin Manager APIs
- Add ADVANCED_PLUGIN_DEVELOPMENT.md with advanced patterns and examples
- Add DEVELOPER_QUICK_REFERENCE.md for quick developer reference
- Consolidate plugin configuration docs into single PLUGIN_CONFIGURATION_GUIDE.md
- Archive completed implementation summaries to docs/archive/
- Enhance PLUGIN_DEVELOPMENT_GUIDE.md with API links and 3rd party submission guidelines
- Update docs/README.md with new API reference sections
- Update root README.md with documentation links

* fix(install): Fix IP detection and network diagnostics after fresh install

- Fix web-ui-info plugin IP detection to handle no internet, AP mode, and network state changes
- Replace socket-based detection with robust interface scanning using hostname -I and ip addr
- Add AP mode detection returning 192.168.4.1 when AP mode is active
- Add periodic IP refresh every 30 seconds to handle network state changes
- Improve network diagnostics in first_time_install.sh showing actual IPs, WiFi status, and AP mode
- Add WiFi connection check in WiFi monitor installation with warnings
- Enhance web service startup logging to show accessible IP addresses
- Update README with network troubleshooting section and fix port references (5001->5000)

Fixes issue where display showed incorrect IP (127.0.11:5000) and users couldn't access web UI after fresh install.

* chore: Add GitHub sponsor button configuration

* fix(wifi): Fix aggressive AP mode enabling and improve WiFi detection

Critical fixes:
- Change auto_enable_ap_mode default from True to False (manual enable only)
- Fixes issue where Pi would disconnect from network after code updates
- Matches documented behavior (was incorrectly defaulting to True in code)

Improvements:
- Add grace period: require 3 consecutive disconnected checks (90s) before enabling AP mode
- Prevents AP mode from enabling on transient network hiccups
- Improve WiFi status detection with retry logic and better nmcli parsing
- Enhanced logging for debugging WiFi connection issues
- Better handling of WiFi device detection (works with any wlan device)

This prevents the WiFi monitor from aggressively enabling AP mode and
disconnecting the Pi from the network when there are brief network issues
or during system initialization.

* fix(wifi): Revert auto_enable_ap_mode default to True with grace period protection

Change default back to True for auto_enable_ap_mode while keeping the grace
period protection that prevents interrupting valid WiFi connections.

- Default auto_enable_ap_mode back to True (useful for setup scenarios)
- Grace period (3 consecutive checks = 90s) prevents false positives
- Improved WiFi detection with retry logic ensures accurate status
- AP mode will auto-enable when truly disconnected, but won't interrupt
  valid connections due to transient detection issues

* fix(news): Update submodule reference for manifest fix

Update ledmatrix-news submodule to include the fixed manifest.json with
required entry_point and class_name fields.

* fix(news): Update submodule reference with validate_config addition

Update ledmatrix-news submodule to include validate_config method for
proper configuration validation.

* feat: Add of-the-day plugin as git submodule

- Add ledmatrix-of-the-day plugin as git submodule
- Rename submodule path from plugins/of-the-day to plugins/ledmatrix-of-the-day to match repository naming convention
- Update .gitignore to allow ledmatrix-of-the-day submodule
- Plugin includes fixes for display rendering and web UI configuration support

* fix(wifi): Make AP mode open network and fix WiFi page loading in AP mode

AP Mode Changes:
- Remove password requirement from AP mode (open network for easier setup)
- Update hostapd config to create open network (no WPA/WPA2)
- Update nmcli hotspot to create open network (no password parameter)

WiFi Page Loading Fixes:
- Download local copies of HTMX and Alpine.js libraries
- Auto-detect AP mode (192.168.4.x) and use local JS files instead of CDN
- Auto-open WiFi tab when accessing via AP mode IP
- Add fallback loading if HTMX fails to load
- Ensures WiFi setup page works in AP mode without internet access

This fixes the issue where the WiFi page wouldn't load on iPhone when
accessing via AP mode (192.168.4.1:5000) because CDN resources couldn't
be fetched without internet connectivity.

* feat(wifi): Add explicit network switching support with clean disconnection

WiFi Manager Improvements:
- Explicitly disconnect from current network before connecting to a new one
- Add skip_ap_check parameter to disconnect_from_network() to prevent AP mode
  from activating during network switches
- Check if already connected to target network to avoid unnecessary work
- Improved logging for network switching operations

Web UI Improvements:
- Detect and display network switching status in UI
- Show 'Switching from [old] to [new]...' message when switching networks
- Enhanced status reloading after connection (multiple checks at 2s, 5s, 10s)
- Better user feedback during network transitions

This ensures clean network switching without AP mode interruptions and
provides clear feedback to users when changing WiFi networks.

* fix(web-ui): Add fallback content loading when HTMX fails to load

Problem:
- After recent updates, web UI showed navigation and CPU status but main
  content tabs never loaded
- Content tabs depend on HTMX's 'revealed' trigger to load
- If HTMX failed to load or initialize, content would never appear

Solutions:
- Enhanced HTMX loading verification with timeout checks
- Added fallback direct fetch for overview tab if HTMX fails
- Added automatic tab content loading when tabs change
- Added loadTabContent() method to manually trigger content loading
- Added global 'htmx-load-failed' event for error handling
- Automatic retry after 5 seconds if HTMX isn't available
- Better error messages and console logging for debugging

This ensures the web UI loads content even if HTMX has issues,
providing graceful degradation and better user experience.

* feat(web-ui): Add support for plugin custom HTML widgets and static file serving

- Add x-widget: custom-html support in config schema generation
- Add loadCustomHtmlWidget() function to load HTML from plugin directories
- Add /api/v3/plugins/<plugin_id>/static/<file_path> endpoint for serving plugin static files
- Enhance execute_plugin_action() to pass params via stdin as JSON for scripts
- Add JSON output parsing for script action responses

These changes enable plugins to provide custom UI components while keeping
all functionality plugin-scoped. Used by of-the-day plugin for file management.

* fix(web-ui): Resolve Alpine.js initialization errors

- Prevent Alpine.js from auto-initializing before app() function is defined
- Add deferLoadingAlpine to ensure proper initialization order
- Make app() function globally available via window.app
- Fix 'app is not defined' and 'activeTab is not defined' errors
- Remove duplicate Alpine.start() calls that caused double initialization warnings

* fix(web-ui): Fix IndentationError in api_v3.py OAuth flow

- Fix indentation in if action_def.get('oauth_flow') block
- Properly indent try/except block and all nested code
- Resolves IndentationError that prevented web interface from starting

* fix(web-ui): Fix SyntaxError in api_v3.py else block

- Fix indentation of OAuth flow code inside else block
- Properly indent else block for simple script execution
- Resolves SyntaxError at line 3458 that prevented web interface from starting

* fix(web-ui): Restructure OAuth flow check to fix SyntaxError

- Move OAuth flow check before script execution in else block
- Remove unreachable code that was causing syntax error
- OAuth check now happens first, then falls back to script execution
- Resolves SyntaxError at line 3458

* fix(web-ui): Define app() function in head for Alpine.js initialization

- Define minimal app() function in head before Alpine.js loads
- Ensures app() is available when Alpine initializes
- Full implementation in body enhances/replaces the stub
- Fixes 'app is not defined' and 'activeTab is not defined' errors

* fix(web-ui): Ensure plugin tabs load when full app() implementation is available

- Update stub init() to detect and use full implementation when available
- Ensure full implementation properly replaces stub methods
- Call init() after merging to load plugins and set up watchers
- Fixes issue where installed plugins weren't showing in navigation bar

* fix(web-ui): Prevent 'Cannot redefine property' error for installedPlugins

- Check if window.installedPlugins property already exists before defining
- Make property configurable to allow redefinition if needed
- Add _initialized flag to prevent multiple init() calls
- Fixes TypeError when stub tries to enhance with full implementation

* fix(web-ui): Fix variable redeclaration errors in logs tab

- Replace let/const declarations with window properties to avoid redeclaration
- Use window._logsEventSource, window._allLogs, etc. to persist across HTMX reloads
- Clean up existing event source before reinitializing
- Remove and re-add event listeners to prevent duplicates
- Fixes 'Identifier has already been declared' error when accessing logs tab multiple times

* feat(web-ui): Add support for additionalProperties object rendering

- Add handler for objects with additionalProperties containing object schemas
- Render dynamic category controls with enable/disable toggles
- Display category metadata (display name, data file path)
- Used by of-the-day plugin for category management

* fix(wifi): Ensure AP mode hotspot is always open (no password)

Problem:
- LEDMatrix-Setup WiFi AP was still asking for password despite code changes
- Existing hotspot connections with passwords weren't being fully cleaned up
- NetworkManager might reuse old connection profiles with passwords

Solutions:
- More thorough cleanup: Delete all hotspot-related connections, not just known names
- Verification: Check if hotspot has password after creation
- Automatic fix: Remove password and restart connection if security is detected
- Better logging: Log when password is detected and removed

This ensures the AP mode hotspot is always open for easy setup access,
even if there were previously saved connections with passwords.

* fix(wifi): Improve network switching reliability and device state handling

Problem:
- Pi failing to switch WiFi networks via web UI
- Connection attempts happening before device is ready
- Disconnect not fully completing before new connection attempt
- Connection name lookup issues when SSID doesn't match connection name

Solutions:
- Improved disconnect logic: Disconnect specific connection first, then device
- Device state verification: Wait for device to be ready (disconnected/unavailable) before connecting
- Better connection lookup: Search by SSID, not just connection name
- Increased wait times: 2 seconds for disconnect to complete
- State checking before activating existing connections
- Enhanced error handling and logging throughout

This ensures network switching works reliably by properly managing device
state transitions and using correct connection identifiers.

* debug(web-ui): Add debug logging for custom HTML widget loading

- Add console logging to track widget generation
- Improve error messages with missing configuration details
- Help diagnose why file manager widget may not be appearing

* fix(web-ui): Fix [object Object] display in categories field

- Add type checking to ensure category values are strings before rendering
- Safely extract data_file and display_name properties
- Prevent object coercion issues in category display

* perf(web-ui): Optimize plugin loading in navigation bar

- Reduce stub init timeout from 100ms to 10ms for faster enhancement
- Change full implementation merge from 50ms setTimeout to requestAnimationFrame
- Add direct plugin loading in stub while waiting for full implementation
- Skip plugin reload in full implementation if already loaded by stub
- Significantly improves plugin tab loading speed in navigation bar

* feat(web-ui): Adapt file-upload widget for JSON files in of-the-day plugin

- Add specialized JSON upload/delete endpoints for of-the-day plugin
- Modify file-upload widget to support JSON files (file_type: json)
- Render JSON files with file-code icon instead of image preview
- Show entry count for JSON files
- Store files in plugins/ledmatrix-of-the-day/of_the_day/ directory
- Automatically update categories config when files are uploaded/deleted
- Populate uploaded_files array from categories on form load
- Remove custom HTML widget, use standard file-upload widget instead

* fix(web-ui): Add working updatePluginTabs to stub for immediate plugin tab rendering

- Stub's updatePluginTabs was empty, preventing tabs from showing
- Add basic implementation that creates plugin tabs in navigation bar
- Ensures plugin tabs appear immediately when plugins load, even before full implementation merges
- Fixes issue where plugin navigation bar wasn't working

* feat(api): Populate uploaded_files and categories from disk for of-the-day plugin

- Scan of_the_day directory for existing JSON files when loading config
- Populate uploaded_files array from files on disk
- Populate categories from files on disk if not in config
- Categories default to disabled, user can enable them
- Ensures existing JSON files (word_of_the_day.json, slovenian_word_of_the_day.json) appear in UI

* fix(api): Improve category merging logic for of-the-day plugin

- Preserve existing category enabled state when merging with files from disk
- Ensure all JSON files from disk appear in categories section
- Categories from files default to disabled, preserving user choices
- Properly merge existing config with scanned files

* fix(wifi): More aggressive password removal for AP mode hotspot

Problem:
- LEDMatrix-Setup network still asking for password despite previous fixes
- NetworkManager may add default security settings to hotspots
- Existing connections with passwords may not be fully cleaned up

Solutions:
- Always remove ALL security settings after creating hotspot (not just when detected)
- Remove multiple security settings: key-mgmt, psk, wep-key, auth-alg
- Verify security was removed and recreate connection if verification fails
- Improved cleanup: Delete connections by SSID match, not just by name
- Disconnect connections before deleting them
- Always restart connection after removing security to apply changes
- Better logging for debugging

This ensures the AP mode hotspot is always open, even if NetworkManager
tries to add default security settings.

* perf(web): Optimize web interface performance and fix JavaScript errors

- Add resource hints (preconnect, dns-prefetch) for CDN resources to reduce DNS lookup delays
- Fix duplicate response parsing bug in loadPluginConfig that was parsing JSON twice
- Replace direct fetch() calls with PluginAPI.getInstalledPlugins() to leverage caching and throttling
- Fix Alpine.js function availability issues with defensive checks and $nextTick
- Enhance request deduplication with debug logging and statistics
- Add response caching headers for static assets and API responses
- Add performance monitoring utilities with detailed metrics

Fixes console errors for loadPluginConfig and generateConfigForm not being defined.
Reduces duplicate API calls to /api/v3/plugins/installed endpoint.
Improves initial page load time with resource hints and optimized JavaScript loading.

* perf(web-ui): optimize CSS for Raspberry Pi performance

- Remove backdrop-filter blur from modal-backdrop
- Remove box-shadow transitions (use transform/opacity only)
- Remove button ::before pseudo-element animation
- Simplify skeleton loader (gradient to opacity pulse)
- Optimize transition utility (specific properties, not 'all')
- Improve color contrast for WCAG AA compliance
- Add CSS containment to cards, plugin-cards, modals
- Remove unused CSS classes (duration-300, divider, divider-light)
- Remove duplicate spacing utility classes

All animations now GPU-accelerated (transform/opacity only).
Optimized for low-powered Raspberry Pi devices.

* fix(web): Resolve ReferenceError for getInstalledPluginsSafe in v3 stub initialization

Move getInstalledPluginsSafe() function definition before the app() stub code that uses it. The function was previously defined at line 3756 but was being called at line 849 during Alpine.js initialization, causing a ReferenceError when loadInstalledPluginsDirectly() attempted to load plugins before the full implementation was ready.

* fix(web): Resolve TypeError for installedPlugins.map in plugin loading

Fix PluginAPI.getInstalledPlugins() to properly extract plugins array from API response structure. The API returns {status: 'success', data: {plugins: [...]}}, but the method was returning response.data (the object) instead of response.data.plugins (the array).

Changes:
- api_client.js: Extract plugins array from response.data.plugins
- plugins_manager.js: Add defensive array checks and handle array return value correctly
- base.html: Add defensive check in getInstalledPluginsSafe() to ensure plugins is always an array

This prevents 'installedPlugins.map is not a function' errors when loading plugins.

* style(web-ui): Enhance navigation bar styling for better readability

- Improve contrast: Change inactive tab text from gray-500 to gray-700
- Add gradient background and thicker border for active tabs
- Enhance hover states with background highlights
- Add smooth transitions using GPU-accelerated properties
- Update all navigation buttons (system tabs and plugin tabs)
- Add updatePluginTabStates() method for dynamic tab state management

All changes are CSS-only with zero performance overhead.

* fix(web-ui): Optimize plugin loading and reduce initialization errors

- Make generateConfigForm accessible to inline Alpine components via parent scope
- Consolidate plugin initialization to prevent duplicate API calls
- Fix script execution from HTMX-loaded content by extracting scripts before DOM insertion
- Add request deduplication to loadInstalledPlugins() to prevent concurrent requests
- Improve Alpine component initialization with proper guards and fallbacks

This eliminates 'generateConfigForm is not defined' errors and reduces plugin
API calls from 3-4 duplicate calls to 1 per page load, significantly improving
page load performance.

* fix(web-ui): Add guard check for generateConfigForm to prevent Alpine errors

Add typeof check in x-show to prevent Alpine from evaluating generateConfigForm
before the component methods are fully initialized. This eliminates the
'generateConfigForm is not defined' error that was occurring during component
initialization.

* fix(web-ui): Fix try-catch block structure in script execution code

Correct the nesting of try-catch block inside the if statement for script execution.
The catch block was incorrectly placed after the else clause, causing a syntax error.

* fix(web-ui): Escape quotes in querySelector to avoid HTML attribute conflicts

Change double quotes to single quotes in the CSS selector to prevent conflicts
with HTML attribute parsing when the x-data expression is embedded.

* style(web): Improve button text readability in Quick Actions section

* fix(web): Resolve Alpine.js expression errors in plugin configuration component

- Capture plugin from parent scope into component data to fix parsing errors
- Update all plugin references to use this.plugin in component methods
- Fix x-init to properly call loadPluginConfig method
- Resolves 'Uncaught ReferenceError' for isOnDemandLoading, onDemandLastUpdated, and other component properties

* fix(web): Fix remaining Alpine.js scope issues in plugin configuration

- Use this.generateConfigForm in typeof checks and method calls
- Fix form submission to use this.plugin.id
- Use $root. prefix for parent scope function calls (refreshPlugin, updatePlugin, etc.)
- Fix confirm dialog string interpolation
- Ensures all component methods and properties are properly scoped

* fix(web): Add this. prefix to all Alpine.js component property references

- Fix all template expressions to use this. prefix for component properties
- Update isOnDemandLoading, onDemandLastUpdated, onDemandRefreshing references
- Update onDemandStatusClass, onDemandStatusText, onDemandServiceClass, onDemandServiceText
- Update disableRunButton, canStopOnDemand, showEnableHint, loading references
- Ensures Alpine.js can properly resolve all component getters and properties

* fix(web): Resolve Alpine.js expression errors in plugin configuration

- Move complex x-data object to pluginConfigData() function for better parsing
- Fix all template expressions to use this.plugin instead of plugin
- Add this. prefix to all method calls in event handlers
- Fix duplicate x-on:click attribute on uninstall button
- Add proper loading state management in loadPluginConfig method

This resolves the 'Invalid or unexpected token' and 'Uncaught ReferenceError'
errors in the browser console.

* fix(web): Fix plugin undefined errors in Alpine.js plugin configuration

- Change x-data initialization to capture plugin from loop scope first
- Use Object.assign in x-init to merge pluginConfigData properties
- Add safety check in pluginConfigData function for undefined plugins
- Ensure plugin is available before accessing properties in expressions

This resolves the 'Cannot read properties of undefined' errors by ensuring
the plugin object is properly captured from the x-for loop scope before
any template expressions try to access it.

* style(web): Make Quick Actions button text styling consistent

- Update Start Display, Stop Display, and Reboot System buttons
- Change from text-sm font-medium to text-base font-semibold
- All Quick Actions buttons now have consistent bold, larger text
- Matches the styling of Update Code, Restart Display Service, and Restart Web Service buttons

* fix(wifi): Properly handle AP mode disable during WiFi connection

- Check return value of disable_ap_mode() before proceeding with connection
- Add verification loop to ensure AP mode is actually disabled
- Increase wait time to 5 seconds for NetworkManager restart stabilization
- Return clear error messages if AP mode cannot be disabled
- Prevents connection failures when switching networks from web UI or AP mode

This fixes the issue where WiFi network switching would fail silently when
AP mode disable failed, leaving the system in an inconsistent state.

* fix(web): Handle API response errors in plugin configuration loading

- Add null/undefined checks before accessing API response status
- Set fallback defaults when API responses don't have status 'success'
- Add error handling for batch API requests with fallback to individual requests
- Add .catch() handlers to individual fetch calls to prevent unhandled rejections
- Add console warnings to help debug API response failures
- Fix applies to both main loadPluginConfig and PluginConfigHelpers.loadPluginConfig

This fixes the issue where plugin configuration sections would get stuck
showing the loading animation when API responses failed or returned error status.

* fix(web): Fix Alpine.js reactivity for plugin config by using direct x-data

Changed from Object.assign pattern to direct x-data assignment to ensure
Alpine.js properly tracks reactive properties. The previous approach used
Object.assign to merge properties into the component after initialization,
which caused Alpine to not detect changes to config/schema properties.

The fix uses pluginConfigData(plugin) directly as x-data, ensuring all
properties including config, schema, loading, etc. are reactive from
component initialization.

* fix(web): Ensure plugin variable is captured in x-data scope

Use spread operator to merge pluginConfigData properties while explicitly
capturing the plugin variable from outer x-for scope. This fixes undefined
plugin errors when Alpine evaluates the component data.

* fix(web): Use $data for Alpine.js reactivity when merging plugin config

Use Object.assign with Alpine's $data reactive proxy instead of this to
ensure added properties are properly reactive. This fixes the issue where
plugin variable scoping from x-for wasn't accessible in x-data expressions.

* fix(web): Remove incorrect 'this.' prefix in Alpine.js template expressions

Alpine.js template expressions (x-show, x-html, x-text, x-on) use the
component data as the implicit context, so 'this.' prefix is incorrect.
In template expressions, 'this' refers to the DOM element, not the
component data.

Changes:
- Replace 'this.plugin.' with 'plugin.' in all template expressions (19 instances)
- Replace 'this.loading' with 'loading' in x-show directives
- Replace 'this.generateConfigForm' with 'generateConfigForm' in x-show/x-html
- Replace 'this.savePluginConfig' with 'savePluginConfig' in x-on:submit
- Replace 'this.config/schema/webUiActions' with direct property access
- Use '$data.loadPluginConfig' in x-init for explicit method call

Note: 'this.' is still correct inside JavaScript method definitions within
pluginConfigData() function since those run with proper object context.

* fix(web): Prevent infinite recursion in plugin config methods

Add 'parent !== this' check to loadPluginConfig, generateConfigForm, and
savePluginConfig methods in pluginConfigData to prevent infinite recursion
when the component tries to delegate to a parent that resolves to itself.

This fixes the 'Maximum call stack size exceeded' error that occurred when
the nested Alpine component's $root reference resolved to a component that
had the same delegating methods via Object.assign.

* fix(web): Resolve infinite recursion in plugin config by calling $root directly

The previous implementation had delegating methods (generateConfigForm,
savePluginConfig) in pluginConfigData that tried to call parent.method(),
but the parent detection via getParentApp() was causing circular calls
because multiple components had the same methods.

Changes:
- Template now calls $root.generateConfigForm() and $root.savePluginConfig()
  directly instead of going through nested component delegation
- Removed delegating generateConfigForm and savePluginConfig from pluginConfigData
- Removed getParentApp() helper that was enabling the circular calls
- Simplified loadPluginConfig to use PluginConfigHelpers directly

This fixes the 'Maximum call stack size exceeded' error when rendering
plugin configuration forms.

* fix(web): Use window.PluginConfigHelpers instead of $root for plugin config

The $root magic variable in Alpine.js doesn't correctly reference the
app() component's data scope from nested x-data contexts. This causes
generateConfigForm and savePluginConfig to be undefined.

Changed to use window.PluginConfigHelpers which has explicit logic to
find and use the app component's methods.

* fix(web): Use direct x-data initialization for plugin config reactivity

Changed from Object.assign($data, pluginConfigData(plugin)) to
x-data="pluginConfigData(plugin)" to ensure Alpine.js properly
tracks reactivity for all plugin config properties. This fixes
the issue where all plugin tabs were showing the same config.

* refactor(web): Implement server-side plugin config rendering with HTMX

Major architectural improvement to plugin configuration management:

- Add server-side Jinja2 template for plugin config forms
  (web_interface/templates/v3/partials/plugin_config.html)
- Add Flask route to serve plugin config partials on-demand
- Replace complex client-side form generation with HTMX lazy loading
- Add Alpine.js store for centralized plugin state management
- Mark old pluginConfigData and PluginConfigHelpers as deprecated

Benefits:
- Lazy loading: configs only load when tab is accessed
- Server-side rendering: reduces client-side complexity
- Better performance: especially on Raspberry Pi
- Cleaner code: Jinja2 macros replace JS string templates
- More maintainable: form logic in one place (server)

The old client-side code is preserved for backwards compatibility
but is no longer used by the main plugin configuration UI.

* fix(web): Trigger HTMX manually after Alpine renders plugin tabs

HTMX processes attributes at page load time, before Alpine.js
renders dynamic content. Changed from :hx-get attribute to
x-init with htmx.ajax() to properly trigger the request after
the element is rendered.

* fix(web): Remove duplicate 'enabled' toggle from plugin config form

The 'enabled' field was appearing twice in plugin configuration:
1. Header toggle (quick action, uses HTMX)
2. Configuration form (from schema, requires save)

Now only the header toggle is shown, avoiding user confusion.
The 'enabled' key is explicitly skipped when rendering schema properties.

* perf(web): Optimize plugin manager with request caching and init guards

Major performance improvements to plugins_manager.js:

1. Request Deduplication & Caching
   - Added pluginLoadCache with 3-second TTL
   - Subsequent calls return cached data instead of making API requests
   - In-flight request deduplication prevents parallel duplicate fetches
   - Added refreshInstalledPlugins() for explicit force-refresh

2. Initialization Guards
   - Added pluginsInitialized flag to prevent multiple initializePlugins() calls
   - Added _eventDelegationSetup guard on container to prevent duplicate listeners
   - Added _listenerSetup guards on search/category inputs

3. Debug Logging Control
   - Added PLUGIN_DEBUG flag (localStorage.setItem('pluginDebug', 'true'))
   - Most console.log calls now use pluginLog() which only logs when debug enabled
   - Reduces console noise from ~150 logs to ~10 in production

Expected improvements:
- API calls reduced from 6+ to 2 on page load
- Event listeners no longer duplicated
- Cleaner console output
- Faster perceived performance

* fix(web): Handle missing search elements in searchPluginStore

The searchPluginStore function was failing silently when called before
the plugin-search and plugin-category elements existed in the DOM.
This caused the plugin store to never load.

Now safely checks if elements exist before accessing their values.

* fix(web): Ensure plugin store loads via pluginManager.searchPluginStore

- Exposed searchPluginStore on window.pluginManager for easier access
- Updated base.html to fallback to pluginManager.searchPluginStore
- Added logging when loading plugin store

* fix(web): Expose searchPluginStore from inside the IIFE

The function was defined inside the IIFE but only exposed after the IIFE
ended, where the function was out of scope. Now exposed immediately after
definition inside the IIFE.

* fix(web): Add cache-busting version to plugins_manager.js URL

Static JS files were being aggressively cached, preventing updates
from being loaded by browsers.

* fix(web): Fix pluginLog reference error outside IIFE

pluginLog is defined inside the IIFE, so use _PLUGIN_DEBUG_EARLY and
console.log directly for code outside the IIFE.

* chore(web): Update plugins_manager.js cache version

* fix(web): Defer plugin store render when grid not ready

Instead of showing an error when plugin-store-grid doesn't exist,
store plugins in window.__pendingStorePlugins for later rendering
when the tab loads (consistent with how installed plugins work).

* chore: Bump JS cache version

* fix(web): Restore enabledBool variable in plugin render

Variable was removed during debug logging optimization but was still
being used in the template string for toggle switch rendering.

* fix(ui): Add header and improve categories section rendering

- Add proper header (h4) to categories section with label
- Add debug logging to diagnose categories field rendering
- Improve additionalProperties condition check readability

* fix(ui): Improve additionalProperties condition check

- Explicitly exclude objects with properties to avoid conflicts
- Ensure categories section is properly detected and rendered
- Categories should show as header with toggles, not text box

* fix(web-ui): Fix JSON parsing errors and default value loading for plugin configs

- Fix JSON parsing errors when saving file upload fields by properly unescaping HTML entities
- Merge config with schema defaults when loading plugin config so form shows default values
- Improve default value handling in form generation for nested objects and arrays
- Add better error handling for malformed JSON in file upload fields

* fix(plugins): Return plugins array from getInstalledPlugins() instead of data object

Fixed PluginAPI.getInstalledPlugins() to return response.data.plugins (array)
instead of response.data (object). This was preventing window.installedPlugins
from being set correctly, which caused plugin configuration tabs to not appear
and prevented users from saving plugin configurations via the web UI.

The fix ensures that:
- window.installedPlugins is properly populated with plugin array
- Plugin tabs are created automatically on page load
- Configuration forms and save buttons are rendered correctly
- Save functionality works as expected

* fix(api): Support form data submission for plugin config saves

The HTMX form submissions use application/x-www-form-urlencoded format
instead of JSON. This update allows the /api/v3/plugins/config POST
endpoint to accept both formats:

- JSON: plugin_id and config in request body (existing behavior)
- Form data: plugin_id from query string, config fields from form

Added _parse_form_value helper to properly convert form strings to
appropriate Python types (bool, int, float, JSON arrays/objects).

* debug: Add form data logging to diagnose config save issue

* fix(web): Re-discover plugins before loading config partial

The plugin config partial was returning 'not found' for plugins
because the plugin manifests weren't loaded. The installed plugins
API was working because it calls discover_plugins() first.

Changes:
- Add discover_plugins() call in _load_plugin_config_partial when
  plugin info is not found on first try
- Remove debug logging from form data handling

* fix(web): Comprehensive plugin config save improvements

SWEEPING FIX for plugin configuration saving issues:

1. Form data now MERGES with existing config instead of replacing
   - Partial form submissions (missing fields) no longer wipe out
     existing config values
   - Fixes plugins with complex schemas (football, clock, etc.)

2. Improved nested value handling with _set_nested_value helper
   - Correctly handles deeply nested structures like customization
   - Properly merges when intermediate objects already exist

3. Better JSON parsing for arrays
   - RGB color arrays like [255, 0, 0] now parse correctly
   - Parse JSON before trying number conversion

4. Bump cache version to force JS reload

* fix(web): Add early stubs for updatePlugin and uninstallPlugin

Ensures these functions are available immediately when the page loads,
even before the full IIFE executes. Provides immediate user feedback
and makes API calls directly.

This fixes the 'Update button does not work' issue by ensuring the
function is always defined and callable.

* fix(web): Support form data in toggle endpoint

The toggle endpoint now accepts both JSON and HTMX form submissions.
Also updated the plugin config template to send the enabled state
via hx-vals when the checkbox changes.

Fixes: 415 Unsupported Media Type error when toggling plugins

* fix(web): Prevent config duplication when toggling plugins

Changed handleToggleResponse to update UI in place instead of
refreshing the entire config partial, which was causing duplication.

Also improved refreshPluginConfig with proper container targeting
and concurrent refresh prevention (though it's no longer needed
for toggles since we update in place).

* fix(api): Schema-aware form value parsing for plugin configs

Major fix for plugin config saving issues:

1. Load schema BEFORE processing form data to enable type-aware parsing
2. New _parse_form_value_with_schema() function that:
   - Converts comma-separated strings to arrays when schema says 'array'
   - Parses JSON strings for arrays/objects
   - Handles empty strings for arrays (returns [] instead of None)
   - Uses schema to determine correct number types
3. Post-processing to ensure None arrays get converted to empty arrays
4. Proper handling of nested object fields

Fixes validation errors:
- 'category_order': Expected type array, got str
- 'categories': Expected type object, got str
- 'uploaded_files': Expected type array, got NoneType
- RGB color arrays: Expected type array, got str

* fix(web): Make plugin config handlers idempotent and remove scripts from HTMX partials

CRITICAL FIX for script redeclaration errors:

1. Removed all <script> tags from plugin_config.html partial
   - Scripts were being re-executed on every HTMX swap
   - Caused 'Identifier already declared' errors

2. Moved all handler functions to base.html with idempotent initialization
   - Added window.__pluginConfigHandlersInitialized guard
   - Functions only initialized once, even if script runs multiple times
   - All state stored on window object (e.g., window.pluginConfigRefreshInProgress)

3. Enhanced error logging:
   - Client-side: Logs form payload, response status, and parsed error details
   - Server-side: Logs raw form data and parsed config on validation failures

4. Functions moved to window scope:
   - toggleSection
   - handleConfigSave (with detailed error logging)
   - handleToggleResponse (updates UI in place, no refresh)
   - handlePluginUpdate
   - refreshPluginConfig (with duplicate prevention)
   - runPluginOnDemand
   - stopOnDemand
   - executePluginAction

This ensures HTMX-swapped fragments only contain HTML, and all
scripts run once in the base layout.

* fix(api): Filter config to only schema-defined fields before validation

When merging with existing_config, fields not in the plugin's schema
(like high_performance_transitions, transition, dynamic_duration)
were being preserved, causing validation failures when
additionalProperties is false.

Add _filter_config_by_schema() function to recursively filter config
to only include fields defined in the schema before validation.

This fixes validation errors like:
- 'Additional properties are not allowed (high_performance_transitions, transition were unexpected)'

* fix(web): Improve update plugin error handling and support form data

1. Enhanced updatePlugin JavaScript function:
   - Validates pluginId before sending request
   - Checks response.ok before parsing JSON
   - Better error logging with request/response details
   - Handles both successful and error responses properly

2. Update endpoint now supports both JSON and form data:
   - Similar to config endpoint, accepts plugin_id from query string or form
   - Better error messages and debug logging

3. Prevent duplicate function definitions:
   - Second updatePlugin definition checks if improved version exists
   - Both definitions now have consistent error handling

Fixes: 400 BAD REQUEST 'Request body must be valid JSON' error

* fix(web): Show correct 'update' message instead of 'save' for plugin updates

The handlePluginUpdate function now:
1. Checks actual HTTP status code (not just event.detail.successful)
2. Parses JSON response to get server's actual message
3. Replaces 'save' with 'update' if message incorrectly says 'save'

Fixes: Update button showing 'saved successfully' instead of
'updated successfully'

* fix(web): Execute plugin updates immediately instead of queuing

Plugin updates are now executed directly (synchronously) instead of
being queued for async processing. This provides immediate feedback
to users about whether the update succeeded or failed.

Updates are fast git pull operations, so they don't need async
processing. The operation queue is reserved for longer operations
like install/uninstall.

Fixes: Update button not actually updating plugins (operations were
queued but users didn't see results)

* fix(web): Ensure toggleSection function is always available for collapsible headers

Moved toggleSection outside the initialization guard block so it's
always defined, even if the plugin config handlers have already been
initialized. This ensures collapsible sections in plugin config forms
work correctly.

Added debug logging to help diagnose if sections/icons aren't found.

Fixes: Collapsible headers in plugin config schema not collapsing

* fix(web): Improve toggleSection to explicitly show/hide collapsible content

Changed from classList.toggle() to explicit add/remove of 'hidden' class
based on current state. This ensures the content visibility is properly
controlled when collapsing/expanding sections.

Added better error checking and state detection for more reliable
collapsible section behavior.

* fix(web): Load plugin tabs on page load instead of waiting for plugin manager tab click

The stub's loadInstalledPlugins was an empty function, so plugin tabs
weren't loading until the plugin manager tab was clicked. Now the stub
implementation:
1. Tries to use global window.loadInstalledPlugins if available
2. Falls back to window.pluginManager.loadInstalledPlugins
3. Finally falls back to direct loading via loadInstalledPluginsDirectly
4. Always updates tabs after loading plugins

This ensures plugin navigation tabs are available immediately on page load.

Fixes: Plugin tabs only loading after clicking plugin manager tab

* fix(web): Ensure plugin navigation tabs load on any page regardless of active tab

Multiple improvements to ensure plugin tabs are always visible:

1. Stub's loadInstalledPluginsDirectly now waits for DOM to be ready
   before updating tabs, using requestAnimationFrame for proper timing

2. Stub's init() now has a retry mechanism that periodically checks
   if plugins have been loaded by plugins_manager.js and updates tabs
   accordingly (checks for 2 seconds)

3. Full implementation's init() now properly handles async plugin loading
   and ensures tabs are updated after loading completes, checking
   window.installedPlugins first before attempting to load

4. Both stub and full implementation ensure tabs update using $nextTick
   to wait for Alpine.js rendering cycle

This ensures plugin navigation tabs are visible immediately when the
page loads, regardless of whether the user is on overview, plugin manager,
or any other tab.

Fixes: Plugin tabs only appearing after clicking plugin manager tab

* fix(web): Fix restart display button not working

The initPluginsPage function was returning early before event listeners
were set up, making all the event listener code unreachable. Moved the
return statement to after all event listeners are attached.

This fixes the restart display button and all other buttons in the
plugin manager (refresh plugins, update all, search, etc.) that depend
on event listeners being set up.

Fixes: Restart Display button not working in plugin manager

* fix(web-ui): Improve categories field rendering for of-the-day plugin

- Add more explicit condition checking for additionalProperties objects
- Add debug logging specifically for categories field
- Add fallback handler for objects that don't match special cases (render as JSON textarea)
- Ensure categories section displays correctly with toggle cards instead of plain text

* fix(install): Prevent following broken symlinks during file ownership setup

- Add -P flag to find commands to prevent following symlinks when traversing
- Add -h flag to chown to operate on symlinks themselves rather than targets
- Exclude scripts/dev/plugins directory which contains development symlinks
- Fixes error when chown tries to dereference broken symlinks with extra LEDMatrix in path

* fix(scroll): Ensure scroll completes fully before switching displays

- Add display_width to total scroll distance calculation
- Scroll now continues until content is completely off screen
- Update scroll completion check to use total_scroll_width + display_width
- Prevents scroll from being cut off mid-way when switching to next display

* fix(install): Remove unsupported -P flag from find commands

- Remove -P flag which is not supported on all find versions
- Keep -h flag on chown to operate on symlinks themselves
- Change to {} \; syntax for better error handling
- Add error suppression to continue on broken symlinks
- Exclude scripts/dev/plugins directory to prevent traversal into broken symlinks

* docs(wifi): Add trailing newline to WiFi AP failover setup guide

* fix(web): Suppress non-critical socket errors and fix WiFi permissions script

- Add error filtering in web interface to suppress harmless client disconnection errors
- Downgrade 'No route to host' and broken pipe errors from ERROR to DEBUG level
- Fix WiFi permissions script to use mktemp instead of manual temp file creation
- Add cleanup trap to ensure temp files are removed on script exit
- Resolves permission denied errors when creating temp files during installation

* fix(web): Ensure plugin navigation tabs load on any page by dispatching events

The issue was that when plugins_manager.js loaded and called
loadInstalledPlugins(), it would set window.installedPlugins but the
Alpine.js component wouldn't know to update its tabs unless the plugin
manager tab was clicked.

Changes:
1. loadInstalledPlugins() now always dispatches a 'pluginsUpdated' event
   when it sets window.installedPlugins, not just when plugin IDs change
2. renderInstalledPlugins() also dispatches the event and always updates
   window.installedPlugins for reactivity
3. Cached plugin data also dispatches the event when returned

The Alpine component already listens for the 'pluginsUpdated' event in
its init() method, so tabs will now update immediately when plugins are
loaded, regardless of which tab is active.

Fixes: Plugin navigation tabs only loading after clicking plugin manager tab

* fix(web): Improve input field contrast in plugin configuration forms

Changed input backgrounds from bg-gray-800 to bg-gray-900 (darker) to
ensure high contrast with white text. Added placeholder:text-gray-400
for better placeholder text visibility.

Updated in both server-side template (plugin_config.html) and client-side
form generation (plugins_manager.js):
- Number inputs
- Text inputs
- Array inputs (comma-separated)
- Select dropdowns
- Textareas (JSON objects)
- Fallback inputs without schema

This ensures all form inputs have high contrast white text on dark
background, making them clearly visible and readable.

Fixes: White text on white background in plugin config inputs

* fix(web): Change plugin config input text from white to black

Changed all input fields in plugin configuration forms to use black text
on white background instead of white text on dark background for better
readability and standard form appearance.

Updated:
- Input backgrounds: bg-gray-900 -> bg-white
- Text color: text-white -> text-black
- Placeholder color: text-gray-400 -> text-gray-500

Applied to both server-side template and client-side form generation
for all input types (number, text, select, textarea).

* fix(web): Ensure toggleSection function is available for plugin config collapsible sections

Moved toggleSection function definition to an early script block so it's
available immediately when HTMX loads plugin configuration content. The
function was previously defined later in the page which could cause it
to not be accessible when inline onclick handlers try to call it.

The function toggles the 'hidden' class on collapsible section content
divs and rotates the chevron icon between right (collapsed) and down
(expanded) states.

Fixes: Plugin configuration section headers not collapsing/expanding

* fix(web): Fix collapsible section toggle to properly hide/show content

Updated toggleSection function to explicitly set display style in addition
to toggling the hidden class. This ensures the content is properly hidden
even if CSS specificity or other styles might interfere with just the
hidden class.

The function now:
- Checks both the hidden class and computed display style
- Explicitly sets display: '' when showing and display: 'none' when hiding
- Rotates chevron icon between right (collapsed) and down (expanded)

This ensures collapsible sections in plugin configuration forms properly
hide and show their content when the header is clicked.

Fixes: Collapsible section headers rotate chevron but don't hide content

* fix(web): Fix collapsible section toggle to work on first click

Simplified the toggle logic to rely primarily on the 'hidden' class check
rather than mixing it with computed display styles. When hiding, we now
remove any inline display style to let Tailwind's 'hidden' class properly
control the display property.

This ensures sections respond correctly on the first click, whether they're
starting in a collapsed or expanded state.

Fixes: Sections requiring 2 clicks to collapse

* fix(web): Ensure collapsible sections start collapsed by default

Added explicit display: none style to nested content divs in plugin config
template to ensure they start collapsed. The hidden class should handle this,
but adding the inline style ensures sections are definitely collapsed on
initial page load.

Sections now:
- Start collapsed (hidden) with chevron pointing right
- Expand when clicked (chevron points down)
- Collapse when clicked again (chevron points right)

This ensures a consistent collapsed initial state across all plugin
configuration sections.

* fix(web): Fix collapsible section toggle to properly collapse on second click

Fixed the toggle logic to explicitly set display: block when showing and
display: none when hiding, rather than clearing the display style. This
ensures the section state is properly tracked and the toggle works correctly
on both expand and collapse clicks.

The function now:
- When hidden: removes hidden class, sets display: block, chevron down
- When visible: adds hidden class, sets display: none, chevron right

This fixes the issue where sections would expand but not collapse again.

Fixes: Sections not collapsing on second click

* feat(web): Ensure plugin navigation tabs load automatically on any page

Implemented comprehensive solution to ensure plugin navigation tabs load
automatically without requiring a visit to the plugin manager page:

1. Global event listener for 'pluginsUpdated' - works even if Alpine isn't
   ready yet, updates tabs directly when plugins_manager.js loads plugins

2. Enhanced stub's loadInstalledPluginsDirectly():
   - Sets window.installedPlugins after loading
   - Dispatches 'pluginsUpdated' event for global listener
   - Adds console logging for debugging

3. Event listener in stub's init() method:
   - Listens for 'pluginsUpdated' events
   - Updates component state and tabs when events fire

4. Fallback timer:
   - If plugins_manager.js hasn't loaded after 2 seconds, fetches
     plugins directly via API
   - Ensures tabs appear even if plugins_manager.js fails

5. Improved checkAndUpdateTabs():
   - Better logging
   - Fallback to direct fetch after timeout

6. Enhanced logging throughout plugin loading flow for debugging

This ensures plugin tabs are visible immediately on page load, regardless
of which tab is active or when plugins_manager.js loads.

Fixes: Plugin navigation tabs only loading after visiting plugin manager

* fix(web): Improve plugin tabs update logging and ensure immediate execution

Enhanced logging in updatePluginTabs() and _doUpdatePluginTabs() to help
debug why tabs aren't appearing. Changed debounce behavior to execute
immediately on first call to ensure tabs appear quickly.

Added detailed console logging with [FULL] prefix to track:
- When updatePluginTabs() is called
- When _doUpdatePluginTabs() executes
- DOM element availability
- Tab creation process
- Final tab count

This will help identify if tabs are being created but not visible, or if
the update function isn't being called at all.

Fixes: Plugin tabs loading but not visible in navigation bar

* fix(web): Prevent duplicate plugin tab updates and clearing

Added debouncing and duplicate prevention to stub's updatePluginTabs() to
prevent tabs from being cleared and re-added multiple times. Also checks
if tabs already match before clearing them.

Changes:
1. Debounce stub's updatePluginTabs() with 100ms delay
2. Check if existing tabs match current plugin list before clearing
3. Global event listener only triggers full implementation's updatePluginTabs
4. Stub's event listener only works in stub mode (before enhancement)

This prevents the issue where tabs were being cleared and re-added
multiple times in rapid succession, which could leave tabs empty.

Fixes: Plugin tabs being cleared and not re-added properly

* fix(web): Fix plugin tabs not rendering when plugins are loaded

Fixed _doUpdatePluginTabs() to properly use component's installedPlugins
instead of checking window.installedPlugins first. Also fixed the 'unchanged'
check to not skip when both lists are empty (first load scenario).

Changes:
1. Check component's installedPlugins first (most up-to-date)
2. Only skip update if plugins exist AND match (don't skip empty lists)
3. Retry if no plugins found (in case they're still loading)
4. Ensure window.installedPlugins is set when loading directly
5. Better logging to show which plugin source is being used

This ensures tabs are rendered when plugins are loaded, even on first page load.

Fixes: Plugin tabs not being drawn despite plugins being loaded

* fix(config): Fix array field parsing and validation for plugin config forms

- Added logic to detect and combine indexed array fields (text_color.0, text_color.1, etc.)
- Fixed array fields incorrectly stored as dicts with numeric keys
- Improved handling of comma-separated array values from form submissions
- Ensures array fields meet minItems requirements before validation
- Resolves 400 BAD REQUEST errors when saving plugin config with RGB color arrays

* fix(config): Improve array field handling and secrets error handling

- Use schema defaults when array fields don't meet minItems requirement
- Add debug logging for array field parsing
- Improve error handling for secrets file writes
- Fix arrays stored as dicts with numeric keys conversion
- Better handling of incomplete array values from form submissions

* fix(config): Convert array elements to correct types (numbers not strings)

- Fix array element type conversion when converting dicts to arrays
- Ensure RGB color arrays have integer elements, not strings
- Apply type conversion for both nested and top-level array fields
- Fixes validation errors: 'Expected type number, got str'

* fix(config): Fix array fields showing 'none' when value is null

- Handle None/null values in array field templates properly
- Use schema defaults when array values are None/null
- Fix applies to both Jinja2 template and JavaScript form generation
- Resolves issue where stock ticker plugin shows 'none' instead of default values

* fix(config): Add novalidate to plugin config form to prevent HTML5 validation blocking saves

- Prevents browser HTML5 validation from blocking form submission
- Allows custom validation logic to handle form data properly
- Fixes issue where save button appears unclickable due to invalid form controls
- Resolves problems with plugins like clock-simple that have nested/array fields

* feat(config): Add helpful form validation with detailed error messages

- Keep HTML5 validation enabled (removed novalidate) to prevent broken configs
- Add validatePluginConfigForm function that shows which fields fail and why
- Automatically expands collapsed sections containing invalid fields
- Focuses first invalid field and scrolls to it
- Shows user-friendly error messages with field names and specific issues
- Prevents form submission until all fields are valid

* fix(schema): Remove core properties from required array during validation

- Core properties (enabled, display_duration, live_priority) are system-managed
- SchemaManager now removes them from required array after injection
- Added default values for core properties (enabled=True, display_duration=15, live_priority=False)
- Updated generate_default_config() to ensure live_priority has default
- Resolves 186 validation issues, reducing to 3 non-blocking warnings (98.4% reduction)
- All 19 of 20 plugins now pass validation without errors

Documentation:
- Created docs/PLUGIN_CONFIG_CORE_PROPERTIES.md explaining core property handling
- Updated existing docs to reflect core property behavior
- Removed temporary audit files and scripts

* fix(ui): Improve button text contrast on white backgrounds

- Changed Screenshot button text from text-gray-700 to text-gray-900
- Added global CSS rule to ensure all buttons with white backgrounds use dark text (text-gray-900) for better readability
- Fixes contrast issues where light text on light backgrounds was illegible

* fix(ui): Add explicit text color to form-control inputs

- Added color: #111827 to .form-control class to ensure dark text on white backgrounds
- Fixes issue where input fields had white text on white background after button contrast fix
- Ensures all form inputs are readable with proper contrast

* docs: Update impact explanation and plugin config documentation

* docs: Improve documentation and fix template inconsistencies

- Add migration guide for script path reorganization (scripts moved to scripts/install/ and scripts/fix_perms/)
- Add breaking changes section to README with migration guidance
- Fix config template: set plugins_directory to 'plugins' to match actual plugin locations
- Fix test template: replace Jinja2 placeholders with plain text to match other templates
- Fix markdown linting: add language identifiers to code blocks (python, text, javascript)
- Update permission guide: document setgid bit (0o2775) for directory modes
- Fix example JSON: pin dependency versions and fix compatible_versions range
- Improve readability: reduce repetition in IMPACT_EXPLANATION.md

* feat(web): Make v3 interface production-ready for local deployment

- Phase 2: Real Service Integration
  - Replace sample data with real psutil system monitoring (CPU, memory, disk, temp, uptime)
  - Integrate display controller to read from /tmp/led_matrix_preview.png snapshot
  - Scan assets/fonts directory and extract font metadata with freetype

- Phase 1: Security & Input Validation
  - Add input validation module with URL, file upload, and config sanitization
  - Add optional CSRF protection (gracefully degrades if flask-wtf missing)
  - Add rate limiting (lenient for local use, prevents accidental abuse)
  - Add file upload validation to font upload endpoint

- Phase 3: Error Handling
  - Add global error handlers for 404, 500, and unhandled exceptions
  - All endpoints have comprehensive try/except blocks

- Phase 4: Monitoring & Observability
  - Add structured logging with JSON format support
  - Add request logging middleware (tracks method, path, status, duration, IP)
  - Add /api/v3/health endpoint with service status checks

- Phase 5: Performance & Caching
  - Add in-memory caching system (separate module to avoid circular imports)
  - Cache font catalog (5 minute TTL)
  - Cache system status (10 second TTL)
  - Invalidate cache on config changes

- All changes are non-blocking with graceful error handling
- Optional dependencies (flask-wtf, flask-limiter) degrade gracefully
- All imports protected with try/except blocks
- Verified compilation and import tests pass

* docs: Fix caching pattern logic flaw and merge conflict resolution plan

- Fix Basic Caching Pattern: Replace broken stale cache fallback with correct pattern
  - Re-fetch cache with large max_age (31536000) in except block instead of checking already-falsy cached variable
  - Fixes both instances in ADVANCED_PLUGIN_DEVELOPMENT.md
  - Matches correct pattern from manager.py.template

- Fix MERGE_CONFLICT_RESOLUTION_PLAN.md merge direction
  - Correct Step 1 to checkout main and merge plugins into it (not vice versa)
  - Update commit message to reflect 'Merge plugins into main' direction
  - Fixes workflow to match documented plugins → main merge

---------

Co-authored-by: Chuck <chuck@example.com>

src/plugin_system/__init__.py

@@ -0,0 +1,30 @@
+"""
+LEDMatrix Plugin System
+
+This module provides the core plugin infrastructure for the LEDMatrix project.
+It enables dynamic loading, management, and discovery of display plugins.
+
+API Version: 1.0.0
+"""
+
+__version__ = "1.0.0"
+__api_version__ = "1.0.0"
+
+from .base_plugin import BasePlugin
+from .plugin_manager import PluginManager
+
+# Import store_manager only when needed to avoid dependency issues
+def get_store_manager():
+    """Get PluginStoreManager, importing only when needed."""
+    try:
+        from .store_manager import PluginStoreManager
+        return PluginStoreManager
+    except ImportError as e:
+        raise ImportError("PluginStoreManager requires additional dependencies. Install requests: pip install requests") from e
+
+__all__ = [
+    'BasePlugin',
+    'PluginManager',
+    'get_store_manager',
+]
+

src/plugin_system/base_plugin.py

@@ -0,0 +1,400 @@
+"""
+Base Plugin Interface
+
+All LEDMatrix plugins must inherit from BasePlugin and implement
+the required abstract methods: update() and display().
+
+API Version: 1.0.0
+Stability: Stable - maintains backward compatibility
+"""
+
+from abc import ABC, abstractmethod
+from typing import Dict, Any, Optional, List
+import logging
+from src.logging_config import get_logger
+
+
+class BasePlugin(ABC):
+    """
+    Base class that all plugins must inherit from.
+    Provides standard interface and helper methods.
+
+    This is the core plugin interface that all plugins must implement.
+    Provides common functionality for logging, configuration, and
+    integration with the LEDMatrix core system.
+    """
+
+    API_VERSION = "1.0.0"
+
+    def __init__(
+        self,
+        plugin_id: str,
+        config: Dict[str, Any],
+        display_manager: Any,
+        cache_manager: Any,
+        plugin_manager: Any,
+    ) -> None:
+        """
+        Standard initialization for all plugins.
+
+        Args:
+            plugin_id: Unique identifier for this plugin instance
+            config: Plugin-specific configuration dictionary
+            display_manager: Shared display manager instance for rendering
+            cache_manager: Shared cache manager instance for data persistence
+            plugin_manager: Reference to plugin manager for inter-plugin communication
+        """
+        self.plugin_id: str = plugin_id
+        self.config: Dict[str, Any] = config
+        self.display_manager: Any = display_manager
+        self.cache_manager: Any = cache_manager
+        self.plugin_manager: Any = plugin_manager
+        self.logger: logging.Logger = get_logger(f"plugin.{plugin_id}", plugin_id=plugin_id)
+        self.enabled: bool = config.get("enabled", True)
+
+        self.logger.info("Initialized plugin: %s", plugin_id)
+
+    @abstractmethod
+    def update(self) -> None:
+        """
+        Fetch/update data for this plugin.
+
+        This method is called based on update_interval specified in the
+        plugin's manifest. It should fetch any necessary data from APIs,
+        databases, or other sources and prepare it for display.
+
+        Use the cache_manager for caching API responses to avoid
+        excessive requests.
+
+        Example:
+            def update(self):
+                cache_key = f"{self.plugin_id}_data"
+                cached = self.cache_manager.get(cache_key, max_age=3600)
+                if cached:
+                    self.data = cached
+                    return
+
+                self.data = self._fetch_from_api()
+                self.cache_manager.set(cache_key, self.data)
+        """
+        raise NotImplementedError("Plugins must implement update()")
+
+    @abstractmethod
+    def display(self, force_clear: bool = False) -> None:
+        """
+        Render this plugin's display.
+
+        This method is called during the display rotation or when the plugin
+        is explicitly requested to render. It should use the display_manager
+        to draw content on the LED matrix.
+
+        Args:
+            force_clear: If True, clear display before rendering
+
+        Example:
+            def display(self, force_clear=False):
+                if force_clear:
+                    self.display_manager.clear()
+
+                self.display_manager.draw_text(
+                    "Hello, World!",
+                    x=5, y=15,
+                    color=(255, 255, 255)
+                )
+
+                self.display_manager.update_display()
+        """
+        raise NotImplementedError("Plugins must implement display()")
+
+    def get_display_duration(self) -> float:
+        """
+        Get the display duration for this plugin instance.
+        
+        Automatically detects duration from:
+        1. self.display_duration instance variable (if exists)
+        2. self.config.get("display_duration", 15.0) (fallback)
+        
+        Can be overridden by plugins to provide dynamic durations based
+        on content (e.g., longer duration for more complex displays).
+
+        Returns:
+            Duration in seconds to display this plugin's content
+        """
+        # Check for instance variable first (common pattern in scoreboard plugins)
+        if hasattr(self, 'display_duration'):
+            try:
+                duration = getattr(self, 'display_duration')
+                # Handle None case
+                if duration is None:
+                    pass  # Fall through to config
+                # Try to convert to float if it's a number or numeric string
+                elif isinstance(duration, (int, float)):
+                    if duration > 0:
+                        return float(duration)
+                # Try converting string representations of numbers
+                elif isinstance(duration, str):
+                    try:
+                        duration_float = float(duration)
+                        if duration_float > 0:
+                            return duration_float
+                    except (ValueError, TypeError):
+                        pass  # Fall through to config
+            except (TypeError, ValueError, AttributeError):
+                pass  # Fall through to config
+        
+        # Fall back to config
+        config_duration = self.config.get("display_duration", 15.0)
+        try:
+            # Ensure config value is also a valid float
+            if isinstance(config_duration, (int, float)):
+                return float(config_duration) if config_duration > 0 else 15.0
+            elif isinstance(config_duration, str):
+                return float(config_duration) if float(config_duration) > 0 else 15.0
+        except (ValueError, TypeError):
+            pass
+        
+        return 15.0
+
+    # ---------------------------------------------------------------------
+    # Dynamic duration support hooks
+    # ---------------------------------------------------------------------
+    def _get_dynamic_duration_config(self) -> Dict[str, Any]:
+        """
+        Retrieve dynamic duration configuration block from plugin config.
+
+        Returns:
+            Dict with configuration values or empty dict if not configured.
+        """
+        value = self.config.get("dynamic_duration", {})
+        if isinstance(value, dict):
+            return value
+        return {}
+
+    def supports_dynamic_duration(self) -> bool:
+        """
+        Determine whether this plugin should use dynamic display durations.
+
+        Plugins can override to implement custom logic. By default this reads the
+        `dynamic_duration.enabled` flag from plugin configuration.
+        """
+        config = self._get_dynamic_duration_config()
+        return bool(config.get("enabled", False))
+
+    def get_dynamic_duration_cap(self) -> Optional[float]:
+        """
+        Return the maximum duration (in seconds) the controller should wait for
+        this plugin to complete its display cycle when using dynamic duration.
+
+        Returns:
+            Positive float value for explicit cap, or None to indicate no
+            additional cap beyond global defaults.
+        """
+        config = self._get_dynamic_duration_config()
+        cap_value = config.get("max_duration_seconds")
+        if cap_value is None:
+            return None
+        try:
+            cap = float(cap_value)
+            if cap <= 0:
+                return None
+            return cap
+        except (TypeError, ValueError):
+            self.logger.warning(
+                "Invalid dynamic_duration.max_duration_seconds for %s: %s",
+                self.plugin_id,
+                cap_value,
+            )
+            return None
+
+    def is_cycle_complete(self) -> bool:
+        """
+        Indicate whether the plugin has completed a full display cycle.
+
+        The display controller calls this after each display iteration when
+        dynamic duration is enabled. Plugins that render multi-step content
+        should override this method and return True only after all content has
+        been shown once.
+
+        Returns:
+            True if the plugin cycle is complete (default behaviour).
+        """
+        return True
+
+    def reset_cycle_state(self) -> None:
+        """
+        Reset any internal counters/state related to cycle tracking.
+
+        Called by the display controller before beginning a new dynamic-duration
+        session. Override in plugins that maintain custom tracking data.
+        """
+        return
+
+    def has_live_priority(self) -> bool:
+        """
+        Check if this plugin has live priority enabled.
+
+        Live priority allows a plugin to take over the display when it has
+        live/urgent content (e.g., live sports games, breaking news).
+
+        Returns:
+            True if live priority is enabled in config, False otherwise
+        """
+        return self.config.get("live_priority", False)
+
+    def has_live_content(self) -> bool:
+        """
+        Check if this plugin currently has live content to display.
+
+        Override this method in your plugin to implement live content detection.
+        This is called by the display controller to determine if a live priority
+        plugin should take over the display.
+
+        Returns:
+            True if plugin has live content, False otherwise
+
+        Example (sports plugin):
+            def has_live_content(self):
+                # Check if there are any live games
+                return hasattr(self, 'live_games') and len(self.live_games) > 0
+
+        Example (news plugin):
+            def has_live_content(self):
+                # Check if there's breaking news
+                return hasattr(self, 'breaking_news') and self.breaking_news
+        """
+        return False
+
+    def get_live_modes(self) -> List[str]:
+        """
+        Get list of display modes that should be used during live priority takeover.
+
+        Override this method to specify which modes should be shown when this
+        plugin has live content. By default, returns all display modes from manifest.
+
+        Returns:
+            List of mode names to display during live priority
+
+        Example:
+            def get_live_modes(self):
+                # Only show live game mode, not upcoming/recent
+                return ['nhl_live', 'nba_live']
+        """
+        # Get display modes from manifest via plugin manager
+        if self.plugin_manager and hasattr(self.plugin_manager, "plugin_manifests"):
+            manifest = self.plugin_manager.plugin_manifests.get(self.plugin_id, {})
+            return manifest.get("display_modes", [self.plugin_id])
+        return [self.plugin_id]
+
+    def validate_config(self) -> bool:
+        """
+        Validate plugin configuration against schema.
+
+        Called during plugin loading to ensure configuration is valid.
+        Override this method to implement custom validation logic.
+
+        Returns:
+            True if config is valid, False otherwise
+
+        Example:
+            def validate_config(self):
+                required_fields = ['api_key', 'city']
+                for field in required_fields:
+                    if field not in self.config:
+                self.logger.error("Missing required field: %s", field)
+                        return False
+                return True
+        """
+        # Basic validation - check that enabled is a boolean if present
+        if "enabled" in self.config:
+            if not isinstance(self.config["enabled"], bool):
+                self.logger.error("'enabled' must be a boolean")
+                return False
+
+        # Check display_duration if present
+        if "display_duration" in self.config:
+            duration = self.config["display_duration"]
+            if not isinstance(duration, (int, float)) or duration <= 0:
+                self.logger.error("'display_duration' must be a positive number")
+                return False
+
+        return True
+
+    def cleanup(self) -> None:
+        """
+        Cleanup resources when plugin is unloaded.
+
+        Override this method to clean up any resources (e.g., close
+        file handles, terminate threads, close network connections).
+
+        This method is called when the plugin is unloaded or when the
+        system is shutting down.
+
+        Example:
+            def cleanup(self):
+                if hasattr(self, 'api_client'):
+                    self.api_client.close()
+                if hasattr(self, 'worker_thread'):
+                    self.worker_thread.stop()
+        """
+        self.logger.info("Cleaning up plugin: %s", self.plugin_id)
+
+    def on_config_change(self, new_config: Dict[str, Any]) -> None:
+        """
+        Called after the plugin configuration has been updated via the web API.
+
+        Plugins may override this to apply changes immediately without a restart.
+        The default implementation updates the in-memory config.
+
+        Args:
+            new_config: The full, merged configuration for this plugin (including
+                        any secret-derived values that are merged at runtime).
+        """
+        # Update config reference
+        self.config = new_config or {}
+
+        # Update simple flags
+        self.enabled = self.config.get("enabled", self.enabled)
+
+    def get_info(self) -> Dict[str, Any]:
+        """
+        Return plugin info for display in web UI.
+
+        Override this method to provide additional information about
+        the plugin's current state.
+
+        Returns:
+            Dict with plugin information including id, enabled status, and config
+
+        Example:
+            def get_info(self):
+                info = super().get_info()
+                info['games_count'] = len(self.games)
+                info['last_update'] = self.last_update_time
+                return info
+        """
+        return {
+            "id": self.plugin_id,
+            "enabled": self.enabled,
+            "config": self.config,
+            "api_version": self.API_VERSION,
+        }
+
+    def on_enable(self) -> None:
+        """
+        Called when plugin is enabled.
+
+        Override this method to perform any actions needed when the
+        plugin is enabled (e.g., start background tasks, open connections).
+        """
+        self.enabled = True
+        self.logger.info("Plugin enabled: %s", self.plugin_id)
+
+    def on_disable(self) -> None:
+        """
+        Called when plugin is disabled.
+
+        Override this method to perform any actions needed when the
+        plugin is disabled (e.g., stop background tasks, close connections).
+        """
+        self.enabled = False
+        self.logger.info("Plugin disabled: %s", self.plugin_id)

src/plugin_system/health_monitor.py

@@ -0,0 +1,319 @@
+"""
+Enhanced plugin health monitoring with background checks and auto-recovery.
+
+Builds on existing PluginHealthTracker to provide:
+- Background health checks
+- Health status determination (healthy/degraded/unhealthy)
+- Auto-recovery suggestions
+- Health metrics aggregation
+"""
+
+import threading
+import time
+from typing import Dict, Any, Optional, List, Callable
+from datetime import datetime, timedelta
+from enum import Enum
+from dataclasses import dataclass
+
+from src.logging_config import get_logger
+
+
+class HealthStatus(Enum):
+    """Overall health status of a plugin."""
+    HEALTHY = "healthy"
+    DEGRADED = "degraded"
+    UNHEALTHY = "unhealthy"
+    UNKNOWN = "unknown"
+
+
+@dataclass
+class HealthMetrics:
+    """Health metrics for a plugin."""
+    plugin_id: str
+    status: HealthStatus
+    last_successful_update: Optional[datetime]
+    error_rate: float  # 0.0 to 1.0
+    average_response_time: Optional[float]  # seconds
+    consecutive_failures: int
+    total_failures: int
+    total_successes: int
+    success_rate: float  # 0.0 to 1.0
+    last_error: Optional[str]
+    circuit_breaker_state: str
+    recovery_suggestions: List[str]
+
+
+class PluginHealthMonitor:
+    """
+    Enhanced health monitoring for plugins.
+    
+    Provides:
+    - Background health checks
+    - Health status determination
+    - Auto-recovery suggestions
+    - Health metrics aggregation
+    """
+    
+    def __init__(
+        self,
+        health_tracker,
+        check_interval: float = 60.0,
+        degraded_threshold: float = 0.5,  # 50% error rate
+        unhealthy_threshold: float = 0.8,  # 80% error rate
+        max_response_time: float = 5.0  # seconds
+    ):
+        """
+        Initialize health monitor.
+        
+        Args:
+            health_tracker: PluginHealthTracker instance
+            check_interval: Interval between background health checks (seconds)
+            degraded_threshold: Error rate threshold for degraded status
+            unhealthy_threshold: Error rate threshold for unhealthy status
+            max_response_time: Maximum acceptable response time (seconds)
+        """
+        self.health_tracker = health_tracker
+        self.check_interval = check_interval
+        self.degraded_threshold = degraded_threshold
+        self.unhealthy_threshold = unhealthy_threshold
+        self.max_response_time = max_response_time
+        self.logger = get_logger(__name__)
+        
+        # Background check thread
+        self._monitor_thread: Optional[threading.Thread] = None
+        self._stop_event = threading.Event()
+        
+        # Health check callbacks
+        self._health_check_callbacks: List[Callable[[str], Dict[str, Any]]] = []
+    
+    def start_monitoring(self) -> None:
+        """Start background health monitoring."""
+        if self._monitor_thread and self._monitor_thread.is_alive():
+            return
+        
+        self._stop_event.clear()
+        self._monitor_thread = threading.Thread(
+            target=self._monitor_loop,
+            daemon=True,
+            name="PluginHealthMonitor"
+        )
+        self._monitor_thread.start()
+        self.logger.info("Started plugin health monitoring")
+    
+    def stop_monitoring(self) -> None:
+        """Stop background health monitoring."""
+        self._stop_event.set()
+        if self._monitor_thread and self._monitor_thread.is_alive():
+            self._monitor_thread.join(timeout=5.0)
+        self.logger.info("Stopped plugin health monitoring")
+    
+    def register_health_check(self, callback: Callable[[str], Dict[str, Any]]) -> None:
+        """
+        Register a callback for health checks.
+        
+        Callback should accept plugin_id and return dict with health info.
+        """
+        self._health_check_callbacks.append(callback)
+    
+    def get_plugin_health_status(self, plugin_id: str) -> HealthStatus:
+        """
+        Determine overall health status for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+        
+        Returns:
+            HealthStatus enum value
+        """
+        if not self.health_tracker:
+            return HealthStatus.UNKNOWN
+        
+        summary = self.health_tracker.get_health_summary(plugin_id)
+        
+        if not summary:
+            return HealthStatus.UNKNOWN
+        
+        # Check circuit breaker state
+        circuit_state = summary.get('circuit_state', 'closed')
+        if circuit_state == 'open':
+            return HealthStatus.UNHEALTHY
+        
+        # Check error rate
+        success_rate = summary.get('success_rate', 100.0)
+        error_rate = 1.0 - (success_rate / 100.0)
+        
+        if error_rate >= self.unhealthy_threshold:
+            return HealthStatus.UNHEALTHY
+        elif error_rate >= self.degraded_threshold:
+            return HealthStatus.DEGRADED
+        else:
+            return HealthStatus.HEALTHY
+    
+    def get_plugin_health_metrics(self, plugin_id: str) -> HealthMetrics:
+        """
+        Get comprehensive health metrics for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+        
+        Returns:
+            HealthMetrics object
+        """
+        if not self.health_tracker:
+            return HealthMetrics(
+                plugin_id=plugin_id,
+                status=HealthStatus.UNKNOWN,
+                last_successful_update=None,
+                error_rate=0.0,
+                average_response_time=None,
+                consecutive_failures=0,
+                total_failures=0,
+                total_successes=0,
+                success_rate=0.0,
+                last_error=None,
+                circuit_breaker_state="unknown",
+                recovery_suggestions=[]
+            )
+        
+        summary = self.health_tracker.get_health_summary(plugin_id)
+        
+        if not summary:
+            return HealthMetrics(
+                plugin_id=plugin_id,
+                status=HealthStatus.UNKNOWN,
+                last_successful_update=None,
+                error_rate=0.0,
+                average_response_time=None,
+                consecutive_failures=0,
+                total_failures=0,
+                total_successes=0,
+                success_rate=0.0,
+                last_error=None,
+                circuit_breaker_state="unknown",
+                recovery_suggestions=[]
+            )
+        
+        # Calculate metrics
+        success_rate = summary.get('success_rate', 100.0) / 100.0
+        error_rate = 1.0 - success_rate
+        
+        # Parse last success time
+        last_success_time = None
+        if summary.get('last_success_time'):
+            try:
+                last_success_time = datetime.fromisoformat(summary['last_success_time'])
+            except (ValueError, TypeError):
+                pass
+        
+        # Determine status
+        status = self.get_plugin_health_status(plugin_id)
+        
+        # Get recovery suggestions
+        recovery_suggestions = self._get_recovery_suggestions(plugin_id, summary, status)
+        
+        return HealthMetrics(
+            plugin_id=plugin_id,
+            status=status,
+            last_successful_update=last_success_time,
+            error_rate=error_rate,
+            average_response_time=None,  # Would need resource monitor for this
+            consecutive_failures=summary.get('consecutive_failures', 0),
+            total_failures=summary.get('total_failures', 0),
+            total_successes=summary.get('total_successes', 0),
+            success_rate=success_rate,
+            last_error=summary.get('last_error'),
+            circuit_breaker_state=summary.get('circuit_state', 'closed'),
+            recovery_suggestions=recovery_suggestions
+        )
+    
+    def get_all_plugin_health(self) -> Dict[str, HealthMetrics]:
+        """
+        Get health metrics for all tracked plugins.
+        
+        Returns:
+            Dictionary mapping plugin_id to HealthMetrics
+        """
+        if not self.health_tracker:
+            return {}
+        
+        summaries = self.health_tracker.get_all_health_summaries()
+        health_metrics = {}
+        
+        for plugin_id in summaries.keys():
+            health_metrics[plugin_id] = self.get_plugin_health_metrics(plugin_id)
+        
+        return health_metrics
+    
+    def _get_recovery_suggestions(
+        self,
+        plugin_id: str,
+        summary: Dict[str, Any],
+        status: HealthStatus
+    ) -> List[str]:
+        """
+        Generate recovery suggestions based on health status.
+        
+        Args:
+            plugin_id: Plugin identifier
+            summary: Health summary from tracker
+            status: Current health status
+        
+        Returns:
+            List of suggested recovery actions
+        """
+        suggestions = []
+        
+        if status == HealthStatus.UNHEALTHY:
+            suggestions.append("Plugin is unhealthy - check plugin logs for errors")
+            suggestions.append("Verify plugin configuration is correct")
+            suggestions.append("Check if plugin dependencies are installed")
+            
+            if summary.get('circuit_state') == 'open':
+                suggestions.append("Circuit breaker is open - plugin is being skipped")
+                suggestions.append("Wait for cooldown period or manually reset health")
+            
+            if summary.get('consecutive_failures', 0) > 0:
+                suggestions.append(f"Plugin has {summary['consecutive_failures']} consecutive failures")
+                suggestions.append("Consider disabling plugin temporarily")
+        
+        elif status == HealthStatus.DEGRADED:
+            suggestions.append("Plugin is degraded - experiencing intermittent failures")
+            suggestions.append("Monitor plugin performance")
+            suggestions.append("Check for resource constraints (CPU, memory)")
+            
+            error_rate = (1.0 - (summary.get('success_rate', 100.0) / 100.0)) * 100
+            suggestions.append(f"Current error rate: {error_rate:.1f}%")
+        
+        elif status == HealthStatus.HEALTHY:
+            suggestions.append("Plugin is healthy - no action needed")
+        
+        # Add specific suggestions based on last error
+        last_error = summary.get('last_error')
+        if last_error:
+            if "timeout" in last_error.lower():
+                suggestions.append("Last error was a timeout - plugin may be slow or unresponsive")
+            elif "import" in last_error.lower() or "module" in last_error.lower():
+                suggestions.append("Last error suggests missing dependencies")
+            elif "permission" in last_error.lower() or "access" in last_error.lower():
+                suggestions.append("Last error suggests permission issues")
+        
+        return suggestions
+    
+    def _monitor_loop(self) -> None:
+        """Background monitoring loop."""
+        while not self._stop_event.is_set():
+            try:
+                # Run health checks for all plugins
+                if self._health_check_callbacks:
+                    # Get list of plugin IDs (would need plugin manager reference)
+                    # For now, just wait
+                    pass
+                
+                # Sleep until next check
+                self._stop_event.wait(self.check_interval)
+                
+            except Exception as e:
+                self.logger.error(f"Error in health monitor loop: {e}", exc_info=True)
+                # Continue monitoring even if there's an error
+                time.sleep(self.check_interval)
+

src/plugin_system/operation_history.py

@@ -0,0 +1,208 @@
+"""
+Operation history and audit log.
+
+Tracks all plugin operations and configuration changes for debugging and auditing.
+"""
+
+import json
+import threading
+from typing import Dict, Any, List, Optional
+from datetime import datetime
+from pathlib import Path
+from dataclasses import dataclass, asdict
+
+from src.logging_config import get_logger
+
+
+@dataclass
+class OperationRecord:
+    """Record of an operation."""
+    operation_id: str
+    operation_type: str
+    plugin_id: Optional[str]
+    timestamp: datetime
+    status: str
+    user: Optional[str] = None
+    details: Optional[Dict[str, Any]] = None
+    error: Optional[str] = None
+    
+    def to_dict(self) -> Dict[str, Any]:
+        """Convert to dictionary for serialization."""
+        result = asdict(self)
+        result['timestamp'] = self.timestamp.isoformat()
+        return result
+    
+    @classmethod
+    def from_dict(cls, data: Dict[str, Any]) -> 'OperationRecord':
+        """Create from dictionary."""
+        if isinstance(data.get('timestamp'), str):
+            data['timestamp'] = datetime.fromisoformat(data['timestamp'])
+        return cls(**data)
+
+
+class OperationHistory:
+    """
+    Operation history and audit log manager.
+    
+    Tracks all plugin operations and configuration changes.
+    """
+    
+    def __init__(
+        self,
+        history_file: Optional[str] = None,
+        max_records: int = 1000,
+        lazy_load: bool = False
+    ):
+        """
+        Initialize operation history.
+        
+        Args:
+            history_file: Path to file for persisting history
+            max_records: Maximum number of records to keep
+            lazy_load: If True, defer loading history file until first access
+        """
+        self.logger = get_logger(__name__)
+        self.history_file = Path(history_file) if history_file else None
+        self.max_records = max_records
+        self._lazy_load = lazy_load
+        self._history_loaded = False
+        
+        # In-memory history
+        self._history: List[OperationRecord] = []
+        self._lock = threading.RLock()
+        
+        # Load history from file if it exists (unless lazy loading)
+        if not self._lazy_load and self.history_file and self.history_file.exists():
+            self._load_history()
+            self._history_loaded = True
+    
+    def _ensure_loaded(self) -> None:
+        """Ensure history is loaded (for lazy loading)."""
+        if not self._history_loaded and self.history_file and self.history_file.exists():
+            self._load_history()
+            self._history_loaded = True
+    
+    def record_operation(
+        self,
+        operation_type: str,
+        plugin_id: Optional[str] = None,
+        status: str = "completed",
+        user: Optional[str] = None,
+        details: Optional[Dict[str, Any]] = None,
+        error: Optional[str] = None,
+        operation_id: Optional[str] = None
+    ) -> str:
+        """
+        Record an operation in history.
+        
+        Args:
+            operation_type: Type of operation (install, update, uninstall, etc.)
+            plugin_id: Plugin identifier
+            status: Operation status
+            user: User who performed operation
+            details: Optional operation details
+            error: Optional error message
+            operation_id: Optional operation ID
+        
+        Returns:
+            Operation record ID
+        """
+        self._ensure_loaded()
+        import uuid
+        record_id = operation_id or str(uuid.uuid4())
+        
+        record = OperationRecord(
+            operation_id=record_id,
+            operation_type=operation_type,
+            plugin_id=plugin_id,
+            timestamp=datetime.now(),
+            status=status,
+            user=user,
+            details=details,
+            error=error
+        )
+        
+        with self._lock:
+            self._history.append(record)
+            
+            # Trim history if needed
+            if len(self._history) > self.max_records:
+                self._history = self._history[-self.max_records:]
+            
+            # Save to file
+            self._save_history()
+        
+        return record_id
+    
+    def get_history(
+        self,
+        limit: int = 100,
+        plugin_id: Optional[str] = None,
+        operation_type: Optional[str] = None
+    ) -> List[OperationRecord]:
+        """
+        Get operation history.
+        
+        Args:
+            limit: Maximum number of records to return
+            plugin_id: Optional filter by plugin ID
+            operation_type: Optional filter by operation type
+        
+        Returns:
+            List of operation records, sorted by timestamp (newest first)
+        """
+        self._ensure_loaded()
+        with self._lock:
+            history = self._history.copy()
+        
+        # Apply filters
+        if plugin_id:
+            history = [r for r in history if r.plugin_id == plugin_id]
+        
+        if operation_type:
+            history = [r for r in history if r.operation_type == operation_type]
+        
+        # Sort by timestamp (newest first)
+        history.sort(key=lambda r: r.timestamp, reverse=True)
+        
+        return history[:limit]
+    
+    def _save_history(self) -> None:
+        """Save history to file."""
+        if not self.history_file:
+            return
+        
+        try:
+            with self._lock:
+                history_data = [record.to_dict() for record in self._history]
+            
+            # Ensure directory exists
+            self.history_file.parent.mkdir(parents=True, exist_ok=True)
+            
+            # Write to file
+            with open(self.history_file, 'w') as f:
+                json.dump(history_data, f, indent=2)
+            
+        except Exception as e:
+            self.logger.error(f"Error saving operation history: {e}", exc_info=True)
+    
+    def _load_history(self) -> None:
+        """Load history from file."""
+        if not self.history_file or not self.history_file.exists():
+            return
+        
+        try:
+            with open(self.history_file, 'r') as f:
+                history_data = json.load(f)
+            
+            with self._lock:
+                self._history = [
+                    OperationRecord.from_dict(record_data)
+                    for record_data in history_data
+                ]
+            
+            self.logger.info(f"Loaded {len(self._history)} operation records from file")
+            
+        except Exception as e:
+            self.logger.error(f"Error loading operation history: {e}", exc_info=True)
+

src/plugin_system/operation_queue.py

@@ -0,0 +1,384 @@
+"""
+Plugin operation queue manager.
+
+Serializes plugin operations to prevent conflicts and provides
+status tracking and cancellation support.
+"""
+
+import threading
+import queue
+import time
+from typing import Dict, Optional, List, Callable, Any
+from datetime import datetime, timedelta
+from pathlib import Path
+import json
+
+from src.plugin_system.operation_types import (
+    PluginOperation, OperationType, OperationStatus
+)
+from src.logging_config import get_logger
+
+
+class PluginOperationQueue:
+    """
+    Manages a queue of plugin operations, executing them serially
+    to prevent conflicts.
+    
+    Features:
+    - Serialized execution (one operation at a time)
+    - Prevents concurrent operations on same plugin
+    - Operation status tracking
+    - Operation cancellation
+    - Operation history
+    """
+    
+    def __init__(
+        self,
+        history_file: Optional[str] = None,
+        max_history: int = 100,
+        lazy_load: bool = False
+    ):
+        """
+        Initialize operation queue.
+        
+        Args:
+            history_file: Optional path to file for persisting operation history
+            max_history: Maximum number of operations to keep in history
+            lazy_load: If True, defer loading history file until first access
+        """
+        self.logger = get_logger(__name__)
+        self.history_file = Path(history_file) if history_file else None
+        self.max_history = max_history
+        self._lazy_load = lazy_load
+        self._history_loaded = False
+        
+        # Operation tracking
+        self._operations: Dict[str, PluginOperation] = {}
+        self._operation_queue: queue.Queue = queue.Queue()
+        self._active_operations: Dict[str, PluginOperation] = {}  # plugin_id -> operation
+        self._operation_history: List[PluginOperation] = []
+        
+        # Threading
+        self._lock = threading.RLock()
+        self._worker_thread: Optional[threading.Thread] = None
+        self._stop_event = threading.Event()
+        
+        # Load history from file if it exists (unless lazy loading)
+        if not self._lazy_load and self.history_file and self.history_file.exists():
+            self._load_history()
+            self._history_loaded = True
+        
+        # Start worker thread
+        self._start_worker()
+    
+    def _ensure_loaded(self) -> None:
+        """Ensure history is loaded (for lazy loading)."""
+        if not self._history_loaded and self.history_file and self.history_file.exists():
+            self._load_history()
+            self._history_loaded = True
+    
+    def enqueue_operation(
+        self,
+        operation_type: OperationType,
+        plugin_id: str,
+        parameters: Optional[Dict] = None,
+        operation_callback: Optional[Callable[[PluginOperation], Dict[str, Any]]] = None
+    ) -> str:
+        """
+        Enqueue a plugin operation.
+        
+        Args:
+            operation_type: Type of operation to perform
+            plugin_id: Plugin identifier
+            parameters: Optional operation parameters
+            operation_callback: Optional callback function to execute the operation.
+                             If None, operation will be queued but not executed.
+        
+        Returns:
+            Operation ID for tracking
+        """
+        with self._lock:
+            # Check if plugin already has an active operation
+            if plugin_id in self._active_operations:
+                active_op = self._active_operations[plugin_id]
+                if active_op.status in [OperationStatus.PENDING, OperationStatus.RUNNING]:
+                    raise ValueError(
+                        f"Plugin {plugin_id} already has an active operation: "
+                        f"{active_op.operation_id} ({active_op.operation_type.value})"
+                    )
+            
+            # Create operation
+            operation = PluginOperation(
+                operation_type=operation_type,
+                plugin_id=plugin_id,
+                parameters=parameters or {},
+            )
+            
+            # Store callback if provided
+            if operation_callback:
+                operation.parameters['_callback'] = operation_callback
+            
+            # Store operation
+            self._operations[operation.operation_id] = operation
+            
+            # Enqueue
+            self._operation_queue.put(operation)
+            self.logger.info(
+                f"Enqueued {operation_type.value} operation for plugin {plugin_id} "
+                f"(operation_id: {operation.operation_id})"
+            )
+            
+            return operation.operation_id
+    
+    def get_operation_status(self, operation_id: str) -> Optional[PluginOperation]:
+        """
+        Get status of an operation.
+        
+        Args:
+            operation_id: Operation identifier
+        
+        Returns:
+            PluginOperation if found, None otherwise
+        """
+        self._ensure_loaded()
+        with self._lock:
+            return self._operations.get(operation_id)
+    
+    def cancel_operation(self, operation_id: str) -> bool:
+        """
+        Cancel a pending operation.
+        
+        Args:
+            operation_id: Operation identifier
+        
+        Returns:
+            True if operation was cancelled, False if not found or already running
+        """
+        with self._lock:
+            operation = self._operations.get(operation_id)
+            if not operation:
+                return False
+            
+            if operation.status == OperationStatus.RUNNING:
+                self.logger.warning(
+                    f"Cannot cancel running operation {operation_id}"
+                )
+                return False
+            
+            if operation.status == OperationStatus.PENDING:
+                operation.status = OperationStatus.CANCELLED
+                operation.completed_at = datetime.now()
+                operation.message = "Operation cancelled by user"
+                self._add_to_history(operation)
+                self.logger.info(f"Cancelled operation {operation_id}")
+                return True
+            
+            return False
+    
+    def get_operation_history(self, limit: int = 50) -> List[PluginOperation]:
+        """
+        Get operation history.
+        
+        Args:
+            limit: Maximum number of operations to return
+        
+        Returns:
+            List of operations, sorted by creation time (newest first)
+        """
+        self._ensure_loaded()
+        with self._lock:
+            # Sort by creation time (newest first)
+            history = sorted(
+                self._operation_history,
+                key=lambda op: op.created_at,
+                reverse=True
+            )
+            return history[:limit]
+    
+    def get_active_operations(self) -> List[PluginOperation]:
+        """
+        Get all currently active operations (pending or running).
+        
+        Returns:
+            List of active operations
+        """
+        with self._lock:
+            active = []
+            for operation in self._operations.values():
+                if operation.status in [OperationStatus.PENDING, OperationStatus.RUNNING]:
+                    active.append(operation)
+            return active
+    
+    def _start_worker(self) -> None:
+        """Start the worker thread that processes operations."""
+        if self._worker_thread and self._worker_thread.is_alive():
+            return
+        
+        self._stop_event.clear()
+        self._worker_thread = threading.Thread(
+            target=self._worker_loop,
+            daemon=True,
+            name="PluginOperationQueueWorker"
+        )
+        self._worker_thread.start()
+        self.logger.info("Started plugin operation queue worker thread")
+    
+    def _worker_loop(self) -> None:
+        """Worker thread loop that processes queued operations."""
+        while not self._stop_event.is_set():
+            try:
+                # Get next operation (with timeout to allow checking stop event)
+                try:
+                    operation = self._operation_queue.get(timeout=1.0)
+                except queue.Empty:
+                    continue
+                
+                # Check if operation was cancelled
+                if operation.status == OperationStatus.CANCELLED:
+                    self._operation_queue.task_done()
+                    continue
+                
+                # Execute operation
+                self._execute_operation(operation)
+                
+                self._operation_queue.task_done()
+                
+            except Exception as e:
+                self.logger.error(f"Error in operation queue worker: {e}", exc_info=True)
+    
+    def _execute_operation(self, operation: PluginOperation) -> None:
+        """
+        Execute a plugin operation.
+        
+        Args:
+            operation: Operation to execute
+        """
+        with self._lock:
+            # Check if plugin already has active operation
+            if operation.plugin_id in self._active_operations:
+                active_op = self._active_operations[operation.plugin_id]
+                if active_op.operation_id != operation.operation_id:
+                    # Different operation for same plugin - mark as failed
+                    operation.status = OperationStatus.FAILED
+                    operation.error = f"Plugin {operation.plugin_id} has another active operation"
+                    operation.completed_at = datetime.now()
+                    self._add_to_history(operation)
+                    return
+            
+            # Mark as running
+            operation.status = OperationStatus.RUNNING
+            operation.started_at = datetime.now()
+            operation.progress = 0.0
+            self._active_operations[operation.plugin_id] = operation
+        
+        try:
+            self.logger.info(
+                f"Executing {operation.operation_type.value} operation for "
+                f"plugin {operation.plugin_id} (operation_id: {operation.operation_id})"
+            )
+            
+            # Get callback from parameters
+            callback = operation.parameters.pop('_callback', None)
+            
+            if callback:
+                # Execute callback
+                operation.progress = 0.1
+                result = callback(operation)
+                
+                # Update operation with result
+                operation.progress = 1.0
+                operation.status = OperationStatus.COMPLETED
+                operation.result = result
+                operation.message = result.get('message', 'Operation completed successfully')
+                
+            else:
+                # No callback - mark as completed (operation was just queued)
+                operation.progress = 1.0
+                operation.status = OperationStatus.COMPLETED
+                operation.message = "Operation queued (no callback provided)"
+            
+        except Exception as e:
+            self.logger.error(
+                f"Error executing operation {operation.operation_id}: {e}",
+                exc_info=True
+            )
+            operation.status = OperationStatus.FAILED
+            operation.error = str(e)
+            operation.message = f"Operation failed: {str(e)}"
+        
+        finally:
+            with self._lock:
+                operation.completed_at = datetime.now()
+                
+                # Remove from active operations
+                if operation.plugin_id in self._active_operations:
+                    if self._active_operations[operation.plugin_id].operation_id == operation.operation_id:
+                        del self._active_operations[operation.plugin_id]
+                
+                # Add to history
+                self._add_to_history(operation)
+                
+                # Save history to file
+                self._save_history()
+    
+    def _add_to_history(self, operation: PluginOperation) -> None:
+        """Add operation to history, maintaining max_history limit."""
+        self._operation_history.append(operation)
+        
+        # Trim history if needed
+        if len(self._operation_history) > self.max_history:
+            # Remove oldest operations
+            self._operation_history.sort(key=lambda op: op.created_at)
+            self._operation_history = self._operation_history[-self.max_history:]
+    
+    def _save_history(self) -> None:
+        """Save operation history to file."""
+        if not self.history_file:
+            return
+        
+        try:
+            with self._lock:
+                # Convert operations to dicts
+                history_data = [op.to_dict() for op in self._operation_history]
+            
+            # Ensure directory exists
+            self.history_file.parent.mkdir(parents=True, exist_ok=True)
+            
+            # Write to file
+            with open(self.history_file, 'w') as f:
+                json.dump(history_data, f, indent=2)
+            
+        except Exception as e:
+            self.logger.warning(f"Error saving operation history: {e}")
+    
+    def _load_history(self) -> None:
+        """Load operation history from file."""
+        if not self.history_file or not self.history_file.exists():
+            return
+        
+        try:
+            with open(self.history_file, 'r') as f:
+                history_data = json.load(f)
+            
+            with self._lock:
+                self._operation_history = [
+                    PluginOperation.from_dict(op_data)
+                    for op_data in history_data
+                ]
+            
+            self.logger.info(f"Loaded {len(self._operation_history)} operations from history")
+            
+        except Exception as e:
+            self.logger.warning(f"Error loading operation history: {e}")
+    
+    def shutdown(self) -> None:
+        """Shutdown the operation queue and worker thread."""
+        self.logger.info("Shutting down plugin operation queue")
+        self._stop_event.set()
+        
+        if self._worker_thread and self._worker_thread.is_alive():
+            self._worker_thread.join(timeout=5.0)
+        
+        # Save history one last time
+        self._save_history()
+

src/plugin_system/operation_types.py

@@ -0,0 +1,91 @@
+"""
+Plugin operation type definitions.
+
+Defines the types of operations that can be performed on plugins
+and their associated data structures.
+"""
+
+from enum import Enum
+from dataclasses import dataclass, field
+from typing import Dict, Any, Optional, List
+from datetime import datetime
+import uuid
+
+
+class OperationType(Enum):
+    """Types of plugin operations."""
+    INSTALL = "install"
+    UPDATE = "update"
+    UNINSTALL = "uninstall"
+    ENABLE = "enable"
+    DISABLE = "disable"
+    CONFIGURE = "configure"
+
+
+class OperationStatus(Enum):
+    """Status of an operation."""
+    PENDING = "pending"
+    RUNNING = "running"
+    COMPLETED = "completed"
+    FAILED = "failed"
+    CANCELLED = "cancelled"
+
+
+@dataclass
+class PluginOperation:
+    """Represents a plugin operation to be executed."""
+    operation_type: OperationType
+    plugin_id: str
+    operation_id: str = field(default_factory=lambda: str(uuid.uuid4()))
+    parameters: Dict[str, Any] = field(default_factory=dict)
+    created_at: datetime = field(default_factory=datetime.now)
+    status: OperationStatus = OperationStatus.PENDING
+    progress: float = 0.0  # 0.0 to 1.0
+    message: str = ""
+    error: Optional[str] = None
+    result: Optional[Dict[str, Any]] = None
+    started_at: Optional[datetime] = None
+    completed_at: Optional[datetime] = None
+    
+    def to_dict(self) -> Dict[str, Any]:
+        """Convert operation to dictionary for serialization."""
+        return {
+            'operation_id': self.operation_id,
+            'operation_type': self.operation_type.value,
+            'plugin_id': self.plugin_id,
+            'parameters': self.parameters,
+            'status': self.status.value,
+            'progress': self.progress,
+            'message': self.message,
+            'error': self.error,
+            'result': self.result,
+            'created_at': self.created_at.isoformat() if self.created_at else None,
+            'started_at': self.started_at.isoformat() if self.started_at else None,
+            'completed_at': self.completed_at.isoformat() if self.completed_at else None,
+        }
+    
+    @classmethod
+    def from_dict(cls, data: Dict[str, Any]) -> 'PluginOperation':
+        """Create operation from dictionary."""
+        op = cls(
+            operation_type=OperationType(data['operation_type']),
+            plugin_id=data['plugin_id'],
+            operation_id=data.get('operation_id', str(uuid.uuid4())),
+            parameters=data.get('parameters', {}),
+            status=OperationStatus(data.get('status', 'pending')),
+            progress=data.get('progress', 0.0),
+            message=data.get('message', ''),
+            error=data.get('error'),
+            result=data.get('result'),
+        )
+        
+        # Parse datetime fields
+        if data.get('created_at'):
+            op.created_at = datetime.fromisoformat(data['created_at'])
+        if data.get('started_at'):
+            op.started_at = datetime.fromisoformat(data['started_at'])
+        if data.get('completed_at'):
+            op.completed_at = datetime.fromisoformat(data['completed_at'])
+        
+        return op
+

src/plugin_system/plugin_executor.py

@@ -0,0 +1,252 @@
+"""
+Plugin Executor
+
+Handles plugin execution (update() and display() calls) with timeout handling,
+error isolation, and performance monitoring.
+"""
+
+import time
+import signal
+from typing import Any, Optional, Dict, Callable
+from threading import Thread, Event
+import logging
+
+from src.exceptions import PluginError
+from src.logging_config import get_logger
+
+
+class TimeoutError(Exception):
+    """Raised when a plugin operation times out."""
+    pass
+
+
+class PluginExecutor:
+    """Handles plugin execution with timeout and error isolation."""
+    
+    def __init__(
+        self,
+        default_timeout: float = 30.0,
+        logger: Optional[logging.Logger] = None
+    ) -> None:
+        """
+        Initialize the plugin executor.
+        
+        Args:
+            default_timeout: Default timeout in seconds for plugin operations
+            logger: Optional logger instance
+        """
+        self.default_timeout = default_timeout
+        self.logger = logger or get_logger(__name__)
+    
+    def execute_with_timeout(
+        self,
+        operation: Callable[[], Any],
+        timeout: Optional[float] = None,
+        plugin_id: Optional[str] = None
+    ) -> Any:
+        """
+        Execute a plugin operation with timeout.
+        
+        Args:
+            operation: Function to execute
+            timeout: Timeout in seconds (None = use default)
+            plugin_id: Optional plugin ID for logging
+            
+        Returns:
+            Result of operation
+            
+        Raises:
+            TimeoutError: If operation times out
+            PluginError: If operation raises an exception
+        """
+        timeout = timeout or self.default_timeout
+        plugin_context = f"plugin {plugin_id}" if plugin_id else "plugin"
+        
+        # Use threading-based timeout (more reliable than signal-based)
+        result_container = {'value': None, 'exception': None, 'completed': False}
+        
+        def target():
+            try:
+                result_container['value'] = operation()
+                result_container['completed'] = True
+            except Exception as e:
+                result_container['exception'] = e
+                result_container['completed'] = True
+        
+        thread = Thread(target=target, daemon=True)
+        thread.start()
+        thread.join(timeout=timeout)
+        
+        if not result_container['completed']:
+            error_msg = f"{plugin_context} operation timed out after {timeout}s"
+            self.logger.error(error_msg)
+            raise TimeoutError(error_msg)
+        
+        if result_container['exception']:
+            error = result_container['exception']
+            error_msg = f"{plugin_context} operation failed: {error}"
+            self.logger.error(error_msg, exc_info=True)
+            raise PluginError(error_msg, plugin_id=plugin_id) from error
+        
+        return result_container['value']
+    
+    def execute_update(
+        self,
+        plugin: Any,
+        plugin_id: str,
+        timeout: Optional[float] = None
+    ) -> bool:
+        """
+        Execute plugin update() method with error handling.
+        
+        Args:
+            plugin: Plugin instance
+            plugin_id: Plugin identifier
+            timeout: Timeout in seconds (None = use default)
+            
+        Returns:
+            True if update succeeded, False otherwise
+        """
+        try:
+            start_time = time.time()
+            self.execute_with_timeout(
+                lambda: plugin.update(),
+                timeout=timeout,
+                plugin_id=plugin_id
+            )
+            duration = time.time() - start_time
+            
+            if duration > 5.0:  # Warn if update takes more than 5 seconds
+                self.logger.warning(
+                    "Plugin %s update() took %.2fs (consider optimizing)",
+                    plugin_id,
+                    duration
+                )
+            
+            return True
+        except TimeoutError:
+            self.logger.error("Plugin %s update() timed out", plugin_id)
+            return False
+        except PluginError:
+            # Already logged in execute_with_timeout
+            return False
+        except Exception as e:
+            self.logger.error(
+                "Unexpected error executing update() for plugin %s: %s",
+                plugin_id,
+                e,
+                exc_info=True
+            )
+            return False
+    
+    def execute_display(
+        self,
+        plugin: Any,
+        plugin_id: str,
+        force_clear: bool = False,
+        display_mode: Optional[str] = None,
+        timeout: Optional[float] = None
+    ) -> bool:
+        """
+        Execute plugin display() method with error handling.
+        
+        Args:
+            plugin: Plugin instance
+            plugin_id: Plugin identifier
+            force_clear: Whether to force clear display
+            display_mode: Optional display mode parameter
+            timeout: Timeout in seconds (None = use default)
+            
+        Returns:
+            True if display succeeded, False otherwise
+        """
+        try:
+            start_time = time.time()
+            
+            # Check if plugin accepts display_mode parameter
+            import inspect
+            sig = inspect.signature(plugin.display)
+            has_display_mode = 'display_mode' in sig.parameters
+            
+            # Capture the return value from the plugin's display() method
+            if has_display_mode and display_mode:
+                result = self.execute_with_timeout(
+                    lambda: plugin.display(display_mode=display_mode, force_clear=force_clear),
+                    timeout=timeout,
+                    plugin_id=plugin_id
+                )
+            else:
+                result = self.execute_with_timeout(
+                    lambda: plugin.display(force_clear=force_clear),
+                    timeout=timeout,
+                    plugin_id=plugin_id
+                )
+            
+            duration = time.time() - start_time
+            
+            if duration > 2.0:  # Warn if display takes more than 2 seconds
+                self.logger.warning(
+                    "Plugin %s display() took %.2fs (consider optimizing)",
+                    plugin_id,
+                    duration
+                )
+            
+            # Return the actual result from the plugin's display() method
+            # If it's a boolean, use it directly. Otherwise, treat None/other as True for backward compatibility
+            if isinstance(result, bool):
+                self.logger.debug(f"Plugin {plugin_id} display() returned boolean: {result}")
+                return result
+            # For backward compatibility: if plugin returns None or something else, treat as success
+            self.logger.debug(f"Plugin {plugin_id} display() returned non-boolean: {result}, treating as True")
+            return True
+        except TimeoutError:
+            self.logger.error("Plugin %s display() timed out", plugin_id)
+            return False
+        except PluginError:
+            # Already logged in execute_with_timeout
+            return False
+        except Exception as e:
+            self.logger.error(
+                "Unexpected error executing display() for plugin %s: %s",
+                plugin_id,
+                e,
+                exc_info=True
+            )
+            return False
+    
+    def execute_safe(
+        self,
+        operation: Callable[[], Any],
+        plugin_id: str,
+        operation_name: str = "operation",
+        timeout: Optional[float] = None,
+        default_return: Any = None
+    ) -> Any:
+        """
+        Execute an operation safely, returning default on error.
+        
+        Args:
+            operation: Function to execute
+            plugin_id: Plugin identifier
+            operation_name: Name of operation for logging
+            timeout: Timeout in seconds (None = use default)
+            default_return: Value to return on error
+            
+        Returns:
+            Result of operation or default_return on error
+        """
+        try:
+            return self.execute_with_timeout(
+                operation,
+                timeout=timeout,
+                plugin_id=plugin_id
+            )
+        except (TimeoutError, PluginError, Exception) as e:
+            self.logger.warning(
+                "Plugin %s %s failed, using default return: %s",
+                plugin_id,
+                operation_name,
+                e
+            )
+            return default_return
+

src/plugin_system/plugin_health.py

@@ -0,0 +1,224 @@
+"""
+Plugin Health Tracker
+
+Tracks plugin health metrics including success/failure rates, consecutive failures,
+and circuit breaker state. Provides automatic recovery mechanisms.
+"""
+
+import time
+import logging
+from typing import Dict, Optional, Any
+from enum import Enum
+
+
+class CircuitState(Enum):
+    """Circuit breaker states."""
+    CLOSED = "closed"  # Normal operation
+    OPEN = "open"  # Circuit open, skipping calls
+    HALF_OPEN = "half_open"  # Testing if plugin recovered
+
+
+class PluginHealthTracker:
+    """
+    Tracks plugin health and manages circuit breaker state.
+    
+    Circuit breaker pattern:
+    - CLOSED: Plugin is healthy, calls proceed normally
+    - OPEN: Plugin has failed too many times, calls are skipped
+    - HALF_OPEN: Testing if plugin has recovered (after cooldown)
+    """
+    
+    def __init__(self, cache_manager, failure_threshold: int = 3, 
+                 cooldown_period: float = 300.0, half_open_timeout: float = 60.0):
+        """
+        Initialize plugin health tracker.
+        
+        Args:
+            cache_manager: Cache manager instance for persistence
+            failure_threshold: Number of consecutive failures before opening circuit
+            cooldown_period: Seconds to wait before attempting recovery (default: 5 minutes)
+            half_open_timeout: Seconds to wait in half-open state before closing (default: 1 minute)
+        """
+        self.cache_manager = cache_manager
+        self.failure_threshold = failure_threshold
+        self.cooldown_period = cooldown_period
+        self.half_open_timeout = half_open_timeout
+        self.logger = logging.getLogger(__name__)
+        
+        # In-memory health state (also persisted to cache)
+        self._health_state: Dict[str, Dict[str, Any]] = {}
+    
+    def _get_health_key(self, plugin_id: str) -> str:
+        """Get cache key for plugin health data."""
+        return f"plugin_health:{plugin_id}"
+    
+    def _load_health_state(self, plugin_id: str) -> Dict[str, Any]:
+        """Load health state from cache or return defaults."""
+        cache_key = self._get_health_key(plugin_id)
+        cached = self.cache_manager.get(cache_key, max_age=None)
+        
+        if cached:
+            return cached
+        
+        # Default state
+        return {
+            'consecutive_failures': 0,
+            'total_failures': 0,
+            'total_successes': 0,
+            'last_success_time': None,
+            'last_failure_time': None,
+            'circuit_state': CircuitState.CLOSED.value,
+            'circuit_opened_time': None,
+            'half_open_start_time': None,
+            'last_error': None
+        }
+    
+    def _save_health_state(self, plugin_id: str, state: Dict[str, Any]) -> None:
+        """Save health state to cache."""
+        cache_key = self._get_health_key(plugin_id)
+        self.cache_manager.set(cache_key, state)  # Persist indefinitely
+        self._health_state[plugin_id] = state
+    
+    def get_health_state(self, plugin_id: str) -> Dict[str, Any]:
+        """Get current health state for a plugin."""
+        if plugin_id not in self._health_state:
+            self._health_state[plugin_id] = self._load_health_state(plugin_id)
+        return self._health_state[plugin_id]
+    
+    def record_success(self, plugin_id: str) -> None:
+        """Record a successful plugin execution."""
+        state = self.get_health_state(plugin_id)
+        current_time = time.time()
+        
+        # Reset consecutive failures
+        state['consecutive_failures'] = 0
+        state['total_successes'] = state.get('total_successes', 0) + 1
+        state['last_success_time'] = current_time
+        
+        # Update circuit state
+        if state['circuit_state'] == CircuitState.HALF_OPEN.value:
+            # Success in half-open state, close the circuit
+            state['circuit_state'] = CircuitState.CLOSED.value
+            state['half_open_start_time'] = None
+            self.logger.info(f"Plugin {plugin_id} recovered, circuit closed")
+        elif state['circuit_state'] == CircuitState.OPEN.value:
+            # Shouldn't happen, but handle it
+            state['circuit_state'] = CircuitState.CLOSED.value
+            state['circuit_opened_time'] = None
+        
+        self._save_health_state(plugin_id, state)
+    
+    def record_failure(self, plugin_id: str, error: Optional[Exception] = None) -> None:
+        """Record a failed plugin execution."""
+        state = self.get_health_state(plugin_id)
+        current_time = time.time()
+        
+        # Increment failure counters
+        state['consecutive_failures'] = state.get('consecutive_failures', 0) + 1
+        state['total_failures'] = state.get('total_failures', 0) + 1
+        state['last_failure_time'] = current_time
+        
+        # Store error message
+        if error:
+            state['last_error'] = str(error)
+        
+        # Check if we should open the circuit
+        if state['consecutive_failures'] >= self.failure_threshold:
+            if state['circuit_state'] == CircuitState.CLOSED.value:
+                state['circuit_state'] = CircuitState.OPEN.value
+                state['circuit_opened_time'] = current_time
+                self.logger.warning(
+                    f"Plugin {plugin_id} circuit opened after {state['consecutive_failures']} consecutive failures"
+                )
+            elif state['circuit_state'] == CircuitState.HALF_OPEN.value:
+                # Failed again in half-open, reopen circuit
+                state['circuit_state'] = CircuitState.OPEN.value
+                state['circuit_opened_time'] = current_time
+                state['half_open_start_time'] = None
+                self.logger.warning(f"Plugin {plugin_id} failed in half-open state, circuit reopened")
+        
+        self._save_health_state(plugin_id, state)
+    
+    def should_skip_plugin(self, plugin_id: str) -> bool:
+        """
+        Check if plugin should be skipped due to circuit breaker.
+        
+        Returns:
+            True if plugin should be skipped, False if it should be called
+        """
+        state = self.get_health_state(plugin_id)
+        current_time = time.time()
+        circuit_state = state.get('circuit_state', CircuitState.CLOSED.value)
+        
+        if circuit_state == CircuitState.CLOSED.value:
+            return False
+        
+        if circuit_state == CircuitState.OPEN.value:
+            # Check if cooldown period has passed
+            circuit_opened_time = state.get('circuit_opened_time')
+            if circuit_opened_time and (current_time - circuit_opened_time) >= self.cooldown_period:
+                # Move to half-open state
+                state['circuit_state'] = CircuitState.HALF_OPEN.value
+                state['half_open_start_time'] = current_time
+                state['circuit_opened_time'] = None
+                self._save_health_state(plugin_id, state)
+                self.logger.info(f"Plugin {plugin_id} circuit moved to half-open state for testing")
+                return False  # Allow one attempt
+            return True  # Still in cooldown
+        
+        if circuit_state == CircuitState.HALF_OPEN.value:
+            # In half-open state, allow calls but check timeout
+            half_open_start = state.get('half_open_start_time')
+            if half_open_start and (current_time - half_open_start) >= self.half_open_timeout:
+                # Timeout in half-open, close circuit if no failures
+                if state.get('consecutive_failures', 0) == 0:
+                    state['circuit_state'] = CircuitState.CLOSED.value
+                    state['half_open_start_time'] = None
+                    self._save_health_state(plugin_id, state)
+                    self.logger.info(f"Plugin {plugin_id} circuit closed after successful half-open period")
+                return False
+            return False  # Allow calls in half-open
+        
+        return False
+    
+    def get_health_summary(self, plugin_id: str) -> Dict[str, Any]:
+        """Get health summary for a plugin."""
+        state = self.get_health_state(plugin_id)
+        
+        total_calls = state.get('total_successes', 0) + state.get('total_failures', 0)
+        success_rate = 0.0
+        if total_calls > 0:
+            success_rate = state.get('total_successes', 0) / total_calls * 100
+        
+        return {
+            'plugin_id': plugin_id,
+            'circuit_state': state.get('circuit_state', CircuitState.CLOSED.value),
+            'consecutive_failures': state.get('consecutive_failures', 0),
+            'total_failures': state.get('total_failures', 0),
+            'total_successes': state.get('total_successes', 0),
+            'success_rate': round(success_rate, 2),
+            'last_success_time': state.get('last_success_time'),
+            'last_failure_time': state.get('last_failure_time'),
+            'last_error': state.get('last_error'),
+            'is_healthy': state.get('circuit_state') == CircuitState.CLOSED.value,
+            'circuit_opened_time': state.get('circuit_opened_time'),
+            'half_open_start_time': state.get('half_open_start_time')
+        }
+    
+    def get_all_health_summaries(self) -> Dict[str, Dict[str, Any]]:
+        """Get health summaries for all tracked plugins."""
+        summaries = {}
+        for plugin_id in self._health_state.keys():
+            summaries[plugin_id] = self.get_health_summary(plugin_id)
+        return summaries
+    
+    def reset_health(self, plugin_id: str) -> None:
+        """Reset health state for a plugin (manual recovery)."""
+        state = self._load_health_state(plugin_id)
+        state['consecutive_failures'] = 0
+        state['circuit_state'] = CircuitState.CLOSED.value
+        state['circuit_opened_time'] = None
+        state['half_open_start_time'] = None
+        self._save_health_state(plugin_id, state)
+        self.logger.info(f"Health state reset for plugin {plugin_id}")
+

src/plugin_system/plugin_loader.py

@@ -0,0 +1,382 @@
+"""
+Plugin Loader
+
+Handles plugin module imports, dependency installation, and class instantiation.
+Extracted from PluginManager to improve separation of concerns.
+"""
+
+import json
+import importlib
+import importlib.util
+import sys
+import subprocess
+from pathlib import Path
+from typing import Dict, Any, Optional, Tuple, Type
+import logging
+
+from src.exceptions import PluginError
+from src.logging_config import get_logger
+from src.common.permission_utils import (
+    ensure_file_permissions,
+    get_plugin_file_mode
+)
+
+
+class PluginLoader:
+    """Handles plugin module loading and class instantiation."""
+    
+    def __init__(self, logger: Optional[logging.Logger] = None) -> None:
+        """
+        Initialize the plugin loader.
+        
+        Args:
+            logger: Optional logger instance
+        """
+        self.logger = logger or get_logger(__name__)
+        self._loaded_modules: Dict[str, Any] = {}
+    
+    def find_plugin_directory(
+        self,
+        plugin_id: str,
+        plugins_dir: Path,
+        plugin_directories: Optional[Dict[str, Path]] = None
+    ) -> Optional[Path]:
+        """
+        Find the plugin directory for a given plugin ID.
+        
+        Tries multiple strategies:
+        1. Use plugin_directories mapping if available
+        2. Direct path matching
+        3. Case-insensitive directory matching
+        4. Manifest-based search
+        
+        Args:
+            plugin_id: Plugin identifier
+            plugins_dir: Base plugins directory
+            plugin_directories: Optional mapping of plugin_id to directory
+            
+        Returns:
+            Path to plugin directory or None if not found
+        """
+        # Strategy 1: Use mapping from discovery
+        if plugin_directories and plugin_id in plugin_directories:
+            plugin_dir = plugin_directories[plugin_id]
+            if plugin_dir.exists():
+                self.logger.debug("Using plugin directory from discovery mapping: %s", plugin_dir)
+                return plugin_dir
+        
+        # Strategy 2: Direct paths
+        plugin_dir = plugins_dir / plugin_id
+        if plugin_dir.exists():
+            return plugin_dir
+        
+        plugin_dir = plugins_dir / f"ledmatrix-{plugin_id}"
+        if plugin_dir.exists():
+            return plugin_dir
+        
+        # Strategy 3: Case-insensitive search
+        normalized_id = plugin_id.lower()
+        for item in plugins_dir.iterdir():
+            if not item.is_dir():
+                continue
+            
+            item_name = item.name
+            if item_name.lower() == normalized_id:
+                return item
+            
+            if item_name.lower() == f"ledmatrix-{plugin_id}".lower():
+                return item
+        
+        # Strategy 4: Manifest-based search
+        self.logger.debug("Directory name search failed for %s, searching by manifest...", plugin_id)
+        for item in plugins_dir.iterdir():
+            if not item.is_dir():
+                continue
+            
+            # Skip if already checked
+            if item.name.lower() == normalized_id or item.name.lower() == f"ledmatrix-{plugin_id}".lower():
+                continue
+            
+            manifest_path = item / "manifest.json"
+            if manifest_path.exists():
+                try:
+                    with open(manifest_path, 'r', encoding='utf-8') as f:
+                        item_manifest = json.load(f)
+                        item_manifest_id = item_manifest.get('id')
+                        if item_manifest_id == plugin_id:
+                            self.logger.info(
+                                "Found plugin %s in directory %s (manifest ID matches)",
+                                plugin_id,
+                                item.name
+                            )
+                            return item
+                except (json.JSONDecodeError, Exception) as e:
+                    self.logger.debug("Skipping %s due to manifest error: %s", item.name, e)
+                    continue
+        
+        return None
+    
+    def install_dependencies(
+        self,
+        plugin_dir: Path,
+        plugin_id: str,
+        timeout: int = 300
+    ) -> bool:
+        """
+        Install plugin dependencies from requirements.txt.
+        
+        Args:
+            plugin_dir: Plugin directory path
+            plugin_id: Plugin identifier
+            timeout: Installation timeout in seconds
+            
+        Returns:
+            True if dependencies installed or not needed, False on error
+        """
+        requirements_file = plugin_dir / "requirements.txt"
+        if not requirements_file.exists():
+            return True  # No dependencies needed
+        
+        # Check if already installed
+        marker_path = plugin_dir / ".dependencies_installed"
+        if marker_path.exists():
+            self.logger.debug("Dependencies already installed for %s", plugin_id)
+            return True
+        
+        try:
+            self.logger.info("Installing dependencies for plugin %s...", plugin_id)
+            result = subprocess.run(
+                [sys.executable, "-m", "pip", "install", "--break-system-packages", "-r", str(requirements_file)],
+                capture_output=True,
+                text=True,
+                timeout=timeout,
+                check=False
+            )
+            
+            if result.returncode == 0:
+                # Mark as installed
+                marker_path.touch()
+                # Set proper file permissions after creating marker
+                ensure_file_permissions(marker_path, get_plugin_file_mode())
+                self.logger.info("Dependencies installed successfully for %s", plugin_id)
+                return True
+            else:
+                self.logger.warning(
+                    "Dependency installation returned non-zero exit code for %s: %s",
+                    plugin_id,
+                    result.stderr
+                )
+                return False
+        except subprocess.TimeoutExpired:
+            self.logger.error("Dependency installation timed out for %s", plugin_id)
+            return False
+        except FileNotFoundError:
+            self.logger.warning("pip not found. Skipping dependency installation for %s", plugin_id)
+            return True
+        except (BrokenPipeError, OSError) as e:
+            # Handle broken pipe errors (errno 32) which can occur during pip downloads
+            # Often caused by network interruptions or output buffer issues
+            if isinstance(e, OSError) and e.errno == 32:
+                self.logger.error(
+                    "Broken pipe error during dependency installation for %s. "
+                    "This usually indicates a network interruption or pip output buffer issue. "
+                    "Try installing again or check your network connection.", plugin_id
+                )
+            else:
+                self.logger.error("OS error during dependency installation for %s: %s", plugin_id, e)
+            return False
+        except Exception as e:
+            self.logger.error("Unexpected error installing dependencies for %s: %s", plugin_id, e, exc_info=True)
+            return False
+    
+    def load_module(
+        self,
+        plugin_id: str,
+        plugin_dir: Path,
+        entry_point: str
+    ) -> Optional[Any]:
+        """
+        Load a plugin module from file.
+        
+        Args:
+            plugin_id: Plugin identifier
+            plugin_dir: Plugin directory path
+            entry_point: Entry point filename (e.g., 'manager.py')
+            
+        Returns:
+            Loaded module or None on error
+        """
+        entry_file = plugin_dir / entry_point
+        if not entry_file.exists():
+            error_msg = f"Entry point file not found: {entry_file} for plugin {plugin_id}"
+            self.logger.error(error_msg)
+            raise PluginError(error_msg, plugin_id=plugin_id, context={'entry_file': str(entry_file)})
+        
+        # Add plugin directory to sys.path if not already there
+        plugin_dir_str = str(plugin_dir)
+        if plugin_dir_str not in sys.path:
+            sys.path.insert(0, plugin_dir_str)
+            self.logger.debug("Added plugin directory to sys.path: %s", plugin_dir_str)
+        
+        # Import the plugin module
+        module_name = f"plugin_{plugin_id.replace('-', '_')}"
+        
+        # Check if already loaded
+        if module_name in sys.modules:
+            self.logger.debug("Module %s already loaded, reusing", module_name)
+            return sys.modules[module_name]
+        
+        spec = importlib.util.spec_from_file_location(module_name, entry_file)
+        if spec is None or spec.loader is None:
+            error_msg = f"Could not create module spec for {entry_file}"
+            self.logger.error(error_msg)
+            raise PluginError(error_msg, plugin_id=plugin_id, context={'entry_file': str(entry_file)})
+        
+        module = importlib.util.module_from_spec(spec)
+        sys.modules[module_name] = module
+        spec.loader.exec_module(module)
+        
+        self._loaded_modules[plugin_id] = module
+        self.logger.debug("Loaded module %s for plugin %s", module_name, plugin_id)
+        
+        return module
+    
+    def get_plugin_class(
+        self,
+        plugin_id: str,
+        module: Any,
+        class_name: str
+    ) -> Type[Any]:
+        """
+        Get the plugin class from a loaded module.
+        
+        Args:
+            plugin_id: Plugin identifier
+            module: Loaded module
+            class_name: Name of the plugin class
+            
+        Returns:
+            Plugin class
+            
+        Raises:
+            PluginError: If class not found
+        """
+        if not hasattr(module, class_name):
+            error_msg = f"Class {class_name} not found in module for plugin {plugin_id}"
+            self.logger.error(error_msg)
+            raise PluginError(
+                error_msg,
+                plugin_id=plugin_id,
+                context={'class_name': class_name, 'module': module.__name__}
+            )
+        
+        plugin_class = getattr(module, class_name)
+        
+        # Verify it's a class
+        if not isinstance(plugin_class, type):
+            error_msg = f"{class_name} is not a class in module for plugin {plugin_id}"
+            self.logger.error(error_msg)
+            raise PluginError(error_msg, plugin_id=plugin_id, context={'class_name': class_name})
+        
+        return plugin_class
+    
+    def instantiate_plugin(
+        self,
+        plugin_id: str,
+        plugin_class: Type[Any],
+        config: Dict[str, Any],
+        display_manager: Any,
+        cache_manager: Any,
+        plugin_manager: Any
+    ) -> Any:
+        """
+        Instantiate a plugin class.
+        
+        Args:
+            plugin_id: Plugin identifier
+            plugin_class: Plugin class to instantiate
+            config: Plugin configuration
+            display_manager: Display manager instance
+            cache_manager: Cache manager instance
+            plugin_manager: Plugin manager instance
+            
+        Returns:
+            Plugin instance
+            
+        Raises:
+            PluginError: If instantiation fails
+        """
+        try:
+            plugin_instance = plugin_class(
+                plugin_id=plugin_id,
+                config=config,
+                display_manager=display_manager,
+                cache_manager=cache_manager,
+                plugin_manager=plugin_manager
+            )
+            self.logger.debug("Instantiated plugin %s", plugin_id)
+            return plugin_instance
+        except Exception as e:
+            error_msg = f"Failed to instantiate plugin {plugin_id}: {e}"
+            self.logger.error(error_msg, exc_info=True)
+            raise PluginError(error_msg, plugin_id=plugin_id) from e
+    
+    def load_plugin(
+        self,
+        plugin_id: str,
+        manifest: Dict[str, Any],
+        plugin_dir: Path,
+        config: Dict[str, Any],
+        display_manager: Any,
+        cache_manager: Any,
+        plugin_manager: Any,
+        install_deps: bool = True
+    ) -> Tuple[Any, Any]:
+        """
+        Complete plugin loading process.
+        
+        Args:
+            plugin_id: Plugin identifier
+            manifest: Plugin manifest
+            plugin_dir: Plugin directory path
+            config: Plugin configuration
+            display_manager: Display manager instance
+            cache_manager: Cache manager instance
+            plugin_manager: Plugin manager instance
+            install_deps: Whether to install dependencies
+            
+        Returns:
+            Tuple of (plugin_instance, module)
+            
+        Raises:
+            PluginError: If loading fails
+        """
+        # Install dependencies if needed
+        if install_deps:
+            self.install_dependencies(plugin_dir, plugin_id)
+        
+        # Load module
+        entry_point = manifest.get('entry_point', 'manager.py')
+        module = self.load_module(plugin_id, plugin_dir, entry_point)
+        if module is None:
+            raise PluginError(f"Failed to load module for plugin {plugin_id}", plugin_id=plugin_id)
+        
+        # Get plugin class
+        class_name = manifest.get('class_name')
+        if not class_name:
+            raise PluginError(f"No class_name in manifest for plugin {plugin_id}", plugin_id=plugin_id)
+        
+        plugin_class = self.get_plugin_class(plugin_id, module, class_name)
+        
+        # Instantiate plugin
+        plugin_instance = self.instantiate_plugin(
+            plugin_id,
+            plugin_class,
+            config,
+            display_manager,
+            cache_manager,
+            plugin_manager
+        )
+        
+        return (plugin_instance, module)
+

src/plugin_system/plugin_manager.py

@@ -0,0 +1,767 @@
+"""
+Plugin Manager
+
+Manages plugin discovery, loading, and lifecycle for the LEDMatrix system.
+Handles dynamic plugin loading from the plugins/ directory.
+
+API Version: 1.0.0
+"""
+
+import os
+import json
+import importlib
+import importlib.util
+import sys
+import subprocess
+import time
+from pathlib import Path
+from typing import Dict, List, Optional, Any
+import logging
+from src.exceptions import PluginError
+from src.logging_config import get_logger
+from src.plugin_system.plugin_loader import PluginLoader
+from src.plugin_system.plugin_executor import PluginExecutor
+from src.plugin_system.plugin_state import PluginStateManager, PluginState
+from src.plugin_system.schema_manager import SchemaManager
+from src.common.permission_utils import (
+    ensure_directory_permissions,
+    get_plugin_dir_mode
+)
+
+
+class PluginManager:
+    """
+    Manages plugin discovery, loading, and lifecycle.
+    
+    The PluginManager is responsible for:
+    - Discovering plugins in the plugins/ directory
+    - Loading plugin modules and instantiating plugin classes
+    - Managing plugin lifecycle (load, unload, reload)
+    - Providing access to loaded plugins
+    - Maintaining plugin manifests
+    
+    Uses composition with specialized components:
+    - PluginLoader: Handles module loading and dependency installation
+    - PluginExecutor: Handles plugin execution with timeout and error isolation
+    - PluginStateManager: Manages plugin state machine
+    """
+    
+    def __init__(self, plugins_dir: str = "plugins", 
+                 config_manager: Optional[Any] = None, 
+                 display_manager: Optional[Any] = None, 
+                 cache_manager: Optional[Any] = None, 
+                 font_manager: Optional[Any] = None) -> None:
+        """
+        Initialize the Plugin Manager.
+        
+        Args:
+            plugins_dir: Path to the plugins directory
+            config_manager: Configuration manager instance
+            display_manager: Display manager instance
+            cache_manager: Cache manager instance
+            font_manager: Font manager instance
+        """
+        self.plugins_dir: Path = Path(plugins_dir)
+        self.config_manager: Optional[Any] = config_manager
+        self.display_manager: Optional[Any] = display_manager
+        self.cache_manager: Optional[Any] = cache_manager
+        self.font_manager: Optional[Any] = font_manager
+        self.logger: logging.Logger = get_logger(__name__)
+        
+        # Initialize plugin system components
+        self.plugin_loader = PluginLoader(logger=self.logger)
+        self.plugin_executor = PluginExecutor(default_timeout=30.0, logger=self.logger)
+        self.state_manager = PluginStateManager(logger=self.logger)
+        self.schema_manager = SchemaManager(plugins_dir=self.plugins_dir, logger=self.logger)
+        
+        # Active plugins
+        self.plugins: Dict[str, Any] = {}
+        self.plugin_manifests: Dict[str, Dict[str, Any]] = {}
+        self.plugin_modules: Dict[str, Any] = {}
+        self.plugin_last_update: Dict[str, float] = {}
+        
+        # Health tracking (optional, set by display_controller if available)
+        self.health_tracker = None
+        self.resource_monitor = None
+        
+        # Ensure plugins directory exists with proper permissions
+        try:
+            ensure_directory_permissions(self.plugins_dir, get_plugin_dir_mode())
+        except (OSError, PermissionError) as e:
+            self.logger.error("Could not create plugins directory %s: %s", self.plugins_dir, e, exc_info=True)
+            raise PluginError(f"Could not create plugins directory: {self.plugins_dir}", context={'error': str(e)}) from e
+
+    def _scan_directory_for_plugins(self, directory: Path) -> List[str]:
+        """
+        Scan a directory for plugins.
+        
+        Args:
+            directory: Directory to scan
+            
+        Returns:
+            List of plugin IDs found
+        """
+        plugin_ids = []
+        
+        if not directory.exists():
+            return plugin_ids
+        
+        try:
+            for item in directory.iterdir():
+                if not item.is_dir():
+                    continue
+                
+                manifest_path = item / "manifest.json"
+                if manifest_path.exists():
+                    try:
+                        with open(manifest_path, 'r', encoding='utf-8') as f:
+                            manifest = json.load(f)
+                            plugin_id = manifest.get('id')
+                            if plugin_id:
+                                plugin_ids.append(plugin_id)
+                                self.plugin_manifests[plugin_id] = manifest
+                                
+                                # Store directory mapping
+                                if not hasattr(self, 'plugin_directories'):
+                                    self.plugin_directories = {}
+                                self.plugin_directories[plugin_id] = item
+                    except (json.JSONDecodeError, PermissionError, OSError) as e:
+                        self.logger.warning("Error reading manifest from %s: %s", manifest_path, e, exc_info=True)
+                        continue
+        except (OSError, PermissionError) as e:
+            self.logger.error("Error scanning directory %s: %s", directory, e, exc_info=True)
+        
+        return plugin_ids
+    
+    def discover_plugins(self) -> List[str]:
+        """
+        Discover all plugins in the plugins directory.
+        
+        Returns:
+            List of plugin IDs
+        """
+        self.logger.info("Discovering plugins in %s", self.plugins_dir)
+        plugin_ids = self._scan_directory_for_plugins(self.plugins_dir)
+        self.logger.info("Discovered %d plugin(s)", len(plugin_ids))
+        return plugin_ids
+
+    def _get_dependency_marker_path(self, plugin_id: str) -> Path:
+        """Get path to dependency installation marker file."""
+        plugin_dir = self.plugins_dir / plugin_id
+        if not plugin_dir.exists():
+            # Try with ledmatrix- prefix
+            plugin_dir = self.plugins_dir / f"ledmatrix-{plugin_id}"
+        return plugin_dir / ".dependencies_installed"
+
+    def _check_dependencies_installed(self, plugin_id: str) -> bool:
+        """Check if dependencies are already installed for a plugin."""
+        marker_path = self._get_dependency_marker_path(plugin_id)
+        return marker_path.exists()
+
+    def _mark_dependencies_installed(self, plugin_id: str) -> None:
+        """Mark dependencies as installed for a plugin."""
+        marker_path = self._get_dependency_marker_path(plugin_id)
+        try:
+            marker_path.touch()
+            # Set proper file permissions after creating marker
+            from src.common.permission_utils import (
+                ensure_file_permissions,
+                get_plugin_file_mode
+            )
+            ensure_file_permissions(marker_path, get_plugin_file_mode())
+        except (OSError, PermissionError) as e:
+            self.logger.warning("Could not create dependency marker for %s: %s", plugin_id, e)
+
+    def _remove_dependency_marker(self, plugin_id: str) -> None:
+        """Remove dependency installation marker."""
+        marker_path = self._get_dependency_marker_path(plugin_id)
+        try:
+            if marker_path.exists():
+                marker_path.unlink()
+        except (OSError, PermissionError) as e:
+            self.logger.warning("Could not remove dependency marker for %s: %s", plugin_id, e)
+
+    def _install_plugin_dependencies(self, requirements_file: Path) -> bool:
+        """
+        Install plugin dependencies from requirements.txt.
+        
+        Args:
+            requirements_file: Path to requirements.txt
+            
+        Returns:
+            True if installation succeeded or not needed, False on error
+        """
+        try:
+            self.logger.info("Installing dependencies from %s", requirements_file)
+            result = subprocess.run(
+                [sys.executable, "-m", "pip", "install", "--break-system-packages", "--no-cache-dir", "-r", str(requirements_file)],
+                capture_output=True,
+                text=True,
+                timeout=300,
+                check=False
+            )
+            
+            if result.returncode == 0:
+                self.logger.info("Dependencies installed successfully")
+                return True
+            else:
+                self.logger.warning("Dependency installation returned non-zero exit code: %s", result.stderr)
+                return False
+        except subprocess.TimeoutExpired:
+            self.logger.error("Dependency installation timed out")
+            return False
+        except FileNotFoundError as e:
+            self.logger.warning("Command not found: %s. Skipping dependency installation", e)
+            return True
+        except (BrokenPipeError, OSError) as e:
+            # Handle broken pipe errors (errno 32) which can occur during pip downloads
+            # Often caused by network interruptions or output buffer issues
+            if isinstance(e, OSError) and e.errno == 32:
+                self.logger.error(
+                    "Broken pipe error during dependency installation. "
+                    "This usually indicates a network interruption or pip output buffer issue. "
+                    "Try installing again or check your network connection."
+                )
+            else:
+                self.logger.error("OS error during dependency installation: %s", e)
+            return False
+        except Exception as e:
+            self.logger.error("Unexpected error installing dependencies: %s", e, exc_info=True)
+            return True
+
+    def load_plugin(self, plugin_id: str) -> bool:
+        """
+        Load a plugin by ID.
+        
+        This method:
+        1. Checks if plugin is already loaded
+        2. Validates the manifest exists
+        3. Uses PluginLoader to import module and instantiate plugin
+        4. Validates the plugin configuration
+        5. Stores the plugin instance
+        6. Updates plugin state
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            True if loaded successfully, False otherwise
+        """
+        if plugin_id in self.plugins:
+            self.logger.warning("Plugin %s already loaded", plugin_id)
+            return True
+        
+        manifest = self.plugin_manifests.get(plugin_id)
+        if not manifest:
+            self.logger.error("No manifest found for plugin: %s", plugin_id)
+            self.state_manager.set_state(plugin_id, PluginState.ERROR)
+            return False
+        
+        try:
+            # Update state to LOADED
+            self.state_manager.set_state(plugin_id, PluginState.LOADED)
+            
+            # Find plugin directory using PluginLoader
+            plugin_directories = getattr(self, 'plugin_directories', None)
+            plugin_dir = self.plugin_loader.find_plugin_directory(
+                plugin_id,
+                self.plugins_dir,
+                plugin_directories
+            )
+            
+            if plugin_dir is None:
+                self.logger.error("Plugin directory not found: %s", plugin_id)
+                self.logger.error("Searched in: %s", self.plugins_dir)
+                self.state_manager.set_state(plugin_id, PluginState.ERROR)
+                return False
+            
+            # Update mapping if found via search
+            if plugin_directories is None or plugin_id not in plugin_directories:
+                if not hasattr(self, 'plugin_directories'):
+                    self.plugin_directories = {}
+                self.plugin_directories[plugin_id] = plugin_dir
+            
+            # Get plugin config
+            if self.config_manager:
+                full_config = self.config_manager.load_config()
+                config = full_config.get(plugin_id, {})
+            else:
+                config = {}
+            
+            # Merge config with schema defaults to ensure all defaults are applied
+            try:
+                defaults = self.schema_manager.generate_default_config(plugin_id, use_cache=True)
+                config = self.schema_manager.merge_with_defaults(config, defaults)
+                self.logger.debug(f"Merged config with schema defaults for {plugin_id}")
+            except Exception as e:
+                self.logger.warning(f"Could not apply schema defaults for {plugin_id}: {e}")
+                # Continue with original config if defaults can't be applied
+            
+            # Use PluginLoader to load plugin
+            plugin_instance, module = self.plugin_loader.load_plugin(
+                plugin_id=plugin_id,
+                manifest=manifest,
+                plugin_dir=plugin_dir,
+                config=config,
+                display_manager=self.display_manager,
+                cache_manager=self.cache_manager,
+                plugin_manager=self,
+                install_deps=True
+            )
+            
+            # Store module
+            self.plugin_modules[plugin_id] = module
+            
+            # Validate configuration
+            if hasattr(plugin_instance, 'validate_config'):
+                try:
+                    if not plugin_instance.validate_config():
+                        self.logger.error("Plugin %s configuration validation failed", plugin_id)
+                        self.state_manager.set_state(plugin_id, PluginState.ERROR)
+                        return False
+                except Exception as e:
+                    self.logger.error("Error validating plugin %s config: %s", plugin_id, e, exc_info=True)
+                    self.state_manager.set_state(plugin_id, PluginState.ERROR, error=e)
+                    return False
+            
+            # Store plugin instance
+            self.plugins[plugin_id] = plugin_instance
+            self.plugin_last_update[plugin_id] = 0.0
+            
+            # Update state based on enabled status
+            if config.get('enabled', True):
+                self.state_manager.set_state(plugin_id, PluginState.ENABLED)
+                # Call on_enable if plugin is enabled
+                if hasattr(plugin_instance, 'on_enable'):
+                    plugin_instance.on_enable()
+            else:
+                self.state_manager.set_state(plugin_id, PluginState.DISABLED)
+            
+            self.logger.info("Loaded plugin: %s", plugin_id)
+            
+            return True
+            
+        except PluginError as e:
+            self.logger.error("Plugin error loading %s: %s", plugin_id, e, exc_info=True)
+            self.state_manager.set_state(plugin_id, PluginState.ERROR, error=e)
+            return False
+        except Exception as e:
+            self.logger.error("Unexpected error loading plugin %s: %s", plugin_id, e, exc_info=True)
+            self.state_manager.set_state(plugin_id, PluginState.ERROR, error=e)
+            return False
+    
+    def unload_plugin(self, plugin_id: str) -> bool:
+        """
+        Unload a plugin by ID.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            True if unloaded successfully, False otherwise
+        """
+        if plugin_id not in self.plugins:
+            self.logger.warning("Plugin %s not loaded", plugin_id)
+            return False
+        
+        try:
+            plugin = self.plugins[plugin_id]
+            
+            # Call cleanup if available
+            if hasattr(plugin, 'cleanup'):
+                try:
+                    plugin.cleanup()
+                except Exception as e:
+                    self.logger.warning("Error during plugin cleanup: %s", e)
+            
+            # Call on_disable if available
+            if hasattr(plugin, 'on_disable'):
+                try:
+                    plugin.on_disable()
+                except Exception as e:
+                    self.logger.warning("Error during plugin on_disable: %s", e)
+            
+            # Remove from active plugins
+            del self.plugins[plugin_id]
+            if plugin_id in self.plugin_last_update:
+                del self.plugin_last_update[plugin_id]
+            
+            # Remove module from sys.modules if present
+            module_name = f"plugin_{plugin_id.replace('-', '_')}"
+            if module_name in sys.modules:
+                del sys.modules[module_name]
+            
+            # Remove from plugin_modules
+            self.plugin_modules.pop(plugin_id, None)
+            
+            # Update state
+            self.state_manager.set_state(plugin_id, PluginState.UNLOADED)
+            self.state_manager.clear_state(plugin_id)
+            
+            self.logger.info("Unloaded plugin: %s", plugin_id)
+            return True
+            
+        except Exception as e:
+            self.logger.error("Error unloading plugin %s: %s", plugin_id, e, exc_info=True)
+            self.state_manager.set_state(plugin_id, PluginState.ERROR, error=e)
+            return False
+    
+    def reload_plugin(self, plugin_id: str) -> bool:
+        """
+        Reload a plugin (unload and load).
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            True if reloaded successfully, False otherwise
+        """
+        self.logger.info("Reloading plugin: %s", plugin_id)
+        
+        # Unload first
+        if plugin_id in self.plugins:
+            if not self.unload_plugin(plugin_id):
+                return False
+        
+        # Re-discover to get updated manifest
+        manifest_path = self.plugins_dir / plugin_id / "manifest.json"
+        if manifest_path.exists():
+            try:
+                with open(manifest_path, 'r', encoding='utf-8') as f:
+                    self.plugin_manifests[plugin_id] = json.load(f)
+            except Exception as e:
+                self.logger.error("Error reading manifest: %s", e, exc_info=True)
+                return False
+        
+        return self.load_plugin(plugin_id)
+    
+    def get_plugin(self, plugin_id: str) -> Optional[Any]:
+        """
+        Get a loaded plugin instance by ID.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Plugin instance or None if not loaded
+        """
+        return self.plugins.get(plugin_id)
+    
+    def get_all_plugins(self) -> Dict[str, Any]:
+        """
+        Get all loaded plugins.
+        
+        Returns:
+            Dict of plugin_id: plugin_instance
+        """
+        return self.plugins.copy()
+    
+    def get_enabled_plugins(self) -> List[str]:
+        """
+        Get list of enabled plugin IDs.
+        
+        Returns:
+            List of plugin IDs that are currently enabled
+        """
+        return [pid for pid, plugin in self.plugins.items() if plugin.enabled]
+    
+    def get_plugin_info(self, plugin_id: str) -> Optional[Dict[str, Any]]:
+        """
+        Get information about a plugin (manifest + runtime info).
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Dict with plugin information or None if not found
+        """
+        manifest = self.plugin_manifests.get(plugin_id)
+        if not manifest:
+            return None
+        
+        info = manifest.copy()
+        
+        # Add runtime information if plugin is loaded
+        plugin = self.plugins.get(plugin_id)
+        if plugin:
+            info['loaded'] = True
+            if hasattr(plugin, 'get_info'):
+                info['runtime_info'] = plugin.get_info()
+        else:
+            info['loaded'] = False
+        
+        # Add state information
+        info['state'] = self.state_manager.get_state_info(plugin_id)
+        
+        return info
+    
+    def get_all_plugin_info(self) -> List[Dict[str, Any]]:
+        """
+        Get information about all plugins.
+        
+        Returns:
+            List of plugin info dictionaries
+        """
+        return [info for info in [self.get_plugin_info(pid) for pid in self.plugin_manifests.keys()] if info]
+    
+    def get_plugin_directory(self, plugin_id: str) -> Optional[str]:
+        """
+        Get the directory path for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Directory path as string or None if not found
+        """
+        if hasattr(self, 'plugin_directories') and plugin_id in self.plugin_directories:
+            return str(self.plugin_directories[plugin_id])
+        
+        plugin_dir = self.plugins_dir / plugin_id
+        if plugin_dir.exists():
+            return str(plugin_dir)
+        
+        plugin_dir = self.plugins_dir / f"ledmatrix-{plugin_id}"
+        if plugin_dir.exists():
+            return str(plugin_dir)
+        
+        return None
+    
+    def get_plugin_display_modes(self, plugin_id: str) -> List[str]:
+        """
+        Get display modes provided by a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            List of display mode names
+        """
+        manifest = self.plugin_manifests.get(plugin_id)
+        if not manifest:
+            return []
+        
+        display_modes = manifest.get('display_modes', [])
+        if isinstance(display_modes, list):
+            return display_modes
+        return []
+    
+    def find_plugin_for_mode(self, mode: str) -> Optional[str]:
+        """
+        Find which plugin provides a given display mode.
+        
+        Args:
+            mode: Display mode identifier
+            
+        Returns:
+            Plugin identifier or None if not found.
+        """
+        normalized_mode = mode.strip().lower()
+        for plugin_id, manifest in self.plugin_manifests.items():
+            display_modes = manifest.get('display_modes')
+            if isinstance(display_modes, list) and display_modes:
+                if any(m.lower() == normalized_mode for m in display_modes):
+                    return plugin_id
+        
+        return None
+
+    def _get_plugin_update_interval(self, plugin_id: str, plugin_instance: Any) -> Optional[float]:
+        """
+        Get the update interval for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            plugin_instance: Plugin instance
+            
+        Returns:
+            Update interval in seconds or None if not configured
+        """
+        # Check manifest first
+        manifest = self.plugin_manifests.get(plugin_id, {})
+        update_interval = manifest.get('update_interval')
+        
+        if update_interval:
+            try:
+                return float(update_interval)
+            except (ValueError, TypeError):
+                pass
+        
+        # Check plugin config
+        if self.config_manager:
+            try:
+                config = self.config_manager.get_config()
+                plugin_config = config.get(plugin_id, {})
+                update_interval = plugin_config.get('update_interval')
+                if update_interval:
+                    try:
+                        return float(update_interval)
+                    except (ValueError, TypeError):
+                        pass
+            except Exception as e:
+                self.logger.debug("Could not get update interval from config: %s", e)
+        
+        # Default: 60 seconds
+        return 60.0
+
+    def run_scheduled_updates(self, current_time: Optional[float] = None) -> None:
+        """
+        Trigger plugin updates based on their defined update intervals.
+        Includes health tracking and circuit breaker logic.
+        Uses PluginExecutor for safe execution with timeout.
+        """
+        if current_time is None:
+            current_time = time.time()
+
+        for plugin_id, plugin_instance in list(self.plugins.items()):
+            if not getattr(plugin_instance, "enabled", True):
+                continue
+
+            if not hasattr(plugin_instance, "update"):
+                continue
+
+            # Check circuit breaker before attempting update
+            if self.health_tracker and self.health_tracker.should_skip_plugin(plugin_id):
+                continue
+
+            # Check if plugin can execute
+            if not self.state_manager.can_execute(plugin_id):
+                continue
+
+            interval = self._get_plugin_update_interval(plugin_id, plugin_instance)
+            if interval is None:
+                continue
+
+            last_update = self.plugin_last_update.get(plugin_id, 0.0)
+
+            if last_update == 0.0 or (current_time - last_update) >= interval:
+                # Update state to RUNNING
+                self.state_manager.set_state(plugin_id, PluginState.RUNNING)
+                
+                try:
+                    # Use PluginExecutor for safe execution
+                    success = False
+                    if self.resource_monitor:
+                        # If resource monitor exists, wrap the call
+                        def monitored_update():
+                            self.resource_monitor.monitor_call(plugin_id, plugin_instance.update)
+                        success = self.plugin_executor.execute_update(
+                            type('obj', (object,), {'update': monitored_update})(),
+                            plugin_id
+                        )
+                    else:
+                        success = self.plugin_executor.execute_update(plugin_instance, plugin_id)
+                    
+                    if success:
+                        self.plugin_last_update[plugin_id] = current_time
+                        self.state_manager.record_update(plugin_id)
+                        # Update state back to ENABLED
+                        self.state_manager.set_state(plugin_id, PluginState.ENABLED)
+                        # Record success
+                        if self.health_tracker:
+                            self.health_tracker.record_success(plugin_id)
+                    else:
+                        # Execution failed (timeout or error)
+                        self.state_manager.set_state(plugin_id, PluginState.ERROR)
+                        if self.health_tracker:
+                            self.health_tracker.record_failure(plugin_id, Exception("Plugin execution failed"))
+                except Exception as exc:  # pylint: disable=broad-except
+                    self.logger.exception("Error updating plugin %s: %s", plugin_id, exc)
+                    self.state_manager.set_state(plugin_id, PluginState.ERROR, error=exc)
+                    # Record failure
+                    if self.health_tracker:
+                        self.health_tracker.record_failure(plugin_id, exc)
+
+    def update_all_plugins(self) -> None:
+        """
+        Update all enabled plugins.
+        Calls update() on each enabled plugin using PluginExecutor.
+        """
+        for plugin_id, plugin_instance in list(self.plugins.items()):
+            if not getattr(plugin_instance, "enabled", True):
+                continue
+            
+            if not hasattr(plugin_instance, "update"):
+                continue
+            
+            # Check if plugin can execute
+            if not self.state_manager.can_execute(plugin_id):
+                continue
+            
+            # Update state to RUNNING
+            self.state_manager.set_state(plugin_id, PluginState.RUNNING)
+            
+            try:
+                success = self.plugin_executor.execute_update(plugin_instance, plugin_id)
+                if success:
+                    self.plugin_last_update[plugin_id] = time.time()
+                    self.state_manager.record_update(plugin_id)
+                    # Update state back to ENABLED
+                    self.state_manager.set_state(plugin_id, PluginState.ENABLED)
+                else:
+                    # Execution failed
+                    self.state_manager.set_state(plugin_id, PluginState.ERROR)
+            except Exception as exc:  # pylint: disable=broad-except
+                self.logger.exception("Error updating plugin %s: %s", plugin_id, exc)
+                self.state_manager.set_state(plugin_id, PluginState.ERROR, error=exc)
+    
+    def get_plugin_health_metrics(self) -> Dict[str, Any]:
+        """
+        Get health metrics for all plugins.
+        
+        Returns:
+            Dictionary mapping plugin_id to health metrics
+        """
+        metrics = {}
+        for plugin_id in self.plugins.keys():
+            plugin_metrics = {}
+            
+            # Get state information
+            state_info = self.state_manager.get_state_info(plugin_id)
+            plugin_metrics.update(state_info)
+            
+            # Get health tracker metrics if available
+            if self.health_tracker:
+                health_info = self.health_tracker.get_plugin_health(plugin_id)
+                plugin_metrics['health'] = health_info
+            else:
+                plugin_metrics['health'] = {'status': 'unknown'}
+            
+            metrics[plugin_id] = plugin_metrics
+        return metrics
+    
+    def get_plugin_resource_metrics(self) -> Dict[str, Any]:
+        """
+        Get resource usage metrics for all plugins.
+        
+        Returns:
+            Dictionary mapping plugin_id to resource metrics
+        """
+        metrics = {}
+        for plugin_id in self.plugins.keys():
+            plugin_metrics = {}
+            
+            # Get state information
+            state_info = self.state_manager.get_state_info(plugin_id)
+            plugin_metrics.update(state_info)
+            
+            # Get resource monitor metrics if available
+            if self.resource_monitor:
+                resource_info = self.resource_monitor.get_plugin_metrics(plugin_id)
+                plugin_metrics['resources'] = resource_info
+            else:
+                plugin_metrics['resources'] = {'status': 'unknown'}
+            
+            metrics[plugin_id] = plugin_metrics
+        return metrics
+    
+    def get_plugin_state(self, plugin_id: str) -> Dict[str, Any]:
+        """
+        Get comprehensive state information for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Dictionary with state information
+        """
+        return self.state_manager.get_state_info(plugin_id)

src/plugin_system/plugin_state.py

@@ -0,0 +1,199 @@
+"""
+Plugin State Management
+
+Manages plugin state machine (loaded → enabled → running → error)
+with state transitions and queries.
+"""
+
+from enum import Enum
+from typing import Optional, Dict, Any
+from datetime import datetime
+import logging
+
+from src.logging_config import get_logger
+
+
+class PluginState(Enum):
+    """Plugin state enumeration."""
+    UNLOADED = "unloaded"  # Plugin not loaded
+    LOADED = "loaded"  # Plugin module loaded but not instantiated
+    ENABLED = "enabled"  # Plugin instantiated and enabled
+    RUNNING = "running"  # Plugin is currently executing
+    ERROR = "error"  # Plugin encountered an error
+    DISABLED = "disabled"  # Plugin is disabled in config
+
+
+class PluginStateManager:
+    """Manages plugin state transitions and queries."""
+    
+    def __init__(self, logger: Optional[logging.Logger] = None) -> None:
+        """
+        Initialize the plugin state manager.
+        
+        Args:
+            logger: Optional logger instance
+        """
+        self.logger = logger or get_logger(__name__)
+        self._states: Dict[str, PluginState] = {}
+        self._state_history: Dict[str, list] = {}
+        self._error_info: Dict[str, Dict[str, Any]] = {}
+        self._last_update: Dict[str, datetime] = {}
+        self._last_display: Dict[str, datetime] = {}
+    
+    def set_state(
+        self,
+        plugin_id: str,
+        state: PluginState,
+        error: Optional[Exception] = None
+    ) -> None:
+        """
+        Set plugin state and record transition.
+        
+        Args:
+            plugin_id: Plugin identifier
+            state: New state
+            error: Optional error if transitioning to ERROR state
+        """
+        old_state = self._states.get(plugin_id, PluginState.UNLOADED)
+        self._states[plugin_id] = state
+        
+        # Record state transition
+        if plugin_id not in self._state_history:
+            self._state_history[plugin_id] = []
+        
+        transition = {
+            'timestamp': datetime.now(),
+            'from': old_state.value,
+            'to': state.value,
+            'error': str(error) if error else None
+        }
+        self._state_history[plugin_id].append(transition)
+        
+        # Store error info if transitioning to ERROR state
+        if state == PluginState.ERROR and error:
+            self._error_info[plugin_id] = {
+                'error': str(error),
+                'error_type': type(error).__name__,
+                'timestamp': datetime.now()
+            }
+        elif state != PluginState.ERROR:
+            # Clear error info when leaving ERROR state
+            self._error_info.pop(plugin_id, None)
+        
+        self.logger.debug(
+            "Plugin %s state transition: %s → %s",
+            plugin_id,
+            old_state.value,
+            state.value
+        )
+    
+    def get_state(self, plugin_id: str) -> PluginState:
+        """
+        Get current state of a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Current plugin state
+        """
+        return self._states.get(plugin_id, PluginState.UNLOADED)
+    
+    def is_loaded(self, plugin_id: str) -> bool:
+        """Check if plugin is loaded."""
+        state = self.get_state(plugin_id)
+        return state in [PluginState.LOADED, PluginState.ENABLED, PluginState.RUNNING]
+    
+    def is_enabled(self, plugin_id: str) -> bool:
+        """Check if plugin is enabled."""
+        state = self.get_state(plugin_id)
+        return state == PluginState.ENABLED
+    
+    def is_running(self, plugin_id: str) -> bool:
+        """Check if plugin is currently running."""
+        state = self.get_state(plugin_id)
+        return state == PluginState.RUNNING
+    
+    def is_error(self, plugin_id: str) -> bool:
+        """Check if plugin is in error state."""
+        state = self.get_state(plugin_id)
+        return state == PluginState.ERROR
+    
+    def can_execute(self, plugin_id: str) -> bool:
+        """Check if plugin can execute (update/display)."""
+        state = self.get_state(plugin_id)
+        return state == PluginState.ENABLED
+    
+    def get_state_history(self, plugin_id: str) -> list:
+        """
+        Get state transition history for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            List of state transitions
+        """
+        return self._state_history.get(plugin_id, [])
+    
+    def get_error_info(self, plugin_id: str) -> Optional[Dict[str, Any]]:
+        """
+        Get error information for a plugin in ERROR state.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Error information dict or None
+        """
+        return self._error_info.get(plugin_id)
+    
+    def record_update(self, plugin_id: str) -> None:
+        """Record that plugin update() was called."""
+        self._last_update[plugin_id] = datetime.now()
+    
+    def record_display(self, plugin_id: str) -> None:
+        """Record that plugin display() was called."""
+        self._last_display[plugin_id] = datetime.now()
+    
+    def get_last_update(self, plugin_id: str) -> Optional[datetime]:
+        """Get timestamp of last update() call."""
+        return self._last_update.get(plugin_id)
+    
+    def get_last_display(self, plugin_id: str) -> Optional[datetime]:
+        """Get timestamp of last display() call."""
+        return self._last_display.get(plugin_id)
+    
+    def get_state_info(self, plugin_id: str) -> Dict[str, Any]:
+        """
+        Get comprehensive state information for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Dictionary with state information
+        """
+        state = self.get_state(plugin_id)
+        info = {
+            'state': state.value,
+            'is_loaded': self.is_loaded(plugin_id),
+            'is_enabled': self.is_enabled(plugin_id),
+            'is_running': self.is_running(plugin_id),
+            'is_error': self.is_error(plugin_id),
+            'can_execute': self.can_execute(plugin_id),
+            'last_update': self.get_last_update(plugin_id),
+            'last_display': self.get_last_display(plugin_id),
+            'error_info': self.get_error_info(plugin_id),
+            'state_history_count': len(self.get_state_history(plugin_id))
+        }
+        return info
+    
+    def clear_state(self, plugin_id: str) -> None:
+        """Clear all state information for a plugin."""
+        self._states.pop(plugin_id, None)
+        self._state_history.pop(plugin_id, None)
+        self._error_info.pop(plugin_id, None)
+        self._last_update.pop(plugin_id, None)
+        self._last_display.pop(plugin_id, None)
+

src/plugin_system/resource_monitor.py

@@ -0,0 +1,344 @@
+"""
+Plugin Resource Monitor
+
+Tracks resource usage (memory, CPU, execution time) for plugins.
+Provides resource limits and performance monitoring.
+"""
+
+import time
+import logging
+import threading
+from typing import Dict, Optional, Any, Callable
+from dataclasses import dataclass, field
+
+try:
+    import psutil
+    PSUTIL_AVAILABLE = True
+except ImportError:
+    PSUTIL_AVAILABLE = False
+
+
+class ResourceLimitExceeded(Exception):
+    """Raised when a plugin exceeds its resource limits."""
+    pass
+
+
+@dataclass
+class ResourceLimits:
+    """Resource limits for a plugin."""
+    max_memory_mb: Optional[float] = None  # Maximum memory in MB
+    max_cpu_percent: Optional[float] = None  # Maximum CPU percentage
+    max_execution_time: Optional[float] = None  # Maximum execution time in seconds
+    warning_threshold: float = 0.8  # Warning at 80% of limit
+
+
+@dataclass
+class ResourceMetrics:
+    """Resource usage metrics for a plugin."""
+    memory_mb: float = 0.0
+    cpu_percent: float = 0.0
+    execution_time: float = 0.0
+    call_count: int = 0
+    total_execution_time: float = 0.0
+    max_execution_time: float = 0.0
+    min_execution_time: float = float('inf')
+    last_update_time: float = field(default_factory=time.time)
+    
+    def update_average_execution_time(self):
+        """Update average execution time."""
+        if self.call_count > 0:
+            self.total_execution_time = self.total_execution_time / self.call_count
+
+
+class PluginResourceMonitor:
+    """
+    Monitors resource usage for plugins.
+    
+    Tracks:
+    - Memory usage (if psutil available)
+    - CPU usage (if psutil available)
+    - Execution time for update() and display() calls
+    - Call counts and statistics
+    """
+    
+    def __init__(self, cache_manager, enable_monitoring: bool = True):
+        """
+        Initialize resource monitor.
+        
+        Args:
+            cache_manager: Cache manager for persisting metrics
+            enable_monitoring: Enable resource monitoring (requires psutil)
+        """
+        self.cache_manager = cache_manager
+        self.enable_monitoring = enable_monitoring and PSUTIL_AVAILABLE
+        self.logger = logging.getLogger(__name__)
+        
+        # Resource metrics per plugin
+        self._metrics: Dict[str, ResourceMetrics] = {}
+        self._limits: Dict[str, ResourceLimits] = {}
+        
+        # Thread-local storage for execution tracking
+        self._local = threading.local()
+        
+        # Lock for thread-safe access
+        self._lock = threading.Lock()
+        
+        if not PSUTIL_AVAILABLE and enable_monitoring:
+            self.logger.warning(
+                "psutil not available - resource monitoring will be limited to execution time only"
+            )
+    
+    def _get_metrics_key(self, plugin_id: str) -> str:
+        """Get cache key for plugin metrics."""
+        return f"plugin_metrics:{plugin_id}"
+    
+    def _get_limits_key(self, plugin_id: str) -> str:
+        """Get cache key for plugin limits."""
+        return f"plugin_limits:{plugin_id}"
+    
+    def get_metrics(self, plugin_id: str) -> ResourceMetrics:
+        """Get current metrics for a plugin."""
+        with self._lock:
+            if plugin_id not in self._metrics:
+                # Try to load from cache
+                cache_key = self._get_metrics_key(plugin_id)
+                cached = self.cache_manager.get(cache_key, max_age=None)
+                if cached:
+                    metrics = ResourceMetrics(**cached)
+                else:
+                    metrics = ResourceMetrics()
+                self._metrics[plugin_id] = metrics
+            return self._metrics[plugin_id]
+    
+    def set_limits(self, plugin_id: str, limits: ResourceLimits) -> None:
+        """Set resource limits for a plugin."""
+        with self._lock:
+            self._limits[plugin_id] = limits
+            # Persist to cache
+            cache_key = self._get_limits_key(plugin_id)
+            self.cache_manager.set(cache_key, {
+                'max_memory_mb': limits.max_memory_mb,
+                'max_cpu_percent': limits.max_cpu_percent,
+                'max_execution_time': limits.max_execution_time,
+                'warning_threshold': limits.warning_threshold
+            })
+    
+    def get_limits(self, plugin_id: str) -> Optional[ResourceLimits]:
+        """Get resource limits for a plugin."""
+        with self._lock:
+            if plugin_id not in self._limits:
+                # Try to load from cache
+                cache_key = self._get_limits_key(plugin_id)
+                cached = self.cache_manager.get(cache_key, max_age=None)
+                if cached:
+                    self._limits[plugin_id] = ResourceLimits(**cached)
+                else:
+                    return None
+            return self._limits[plugin_id]
+    
+    def _get_process_memory_mb(self) -> float:
+        """Get current process memory usage in MB."""
+        if not self.enable_monitoring:
+            return 0.0
+        try:
+            process = psutil.Process()
+            return process.memory_info().rss / 1024 / 1024
+        except Exception:
+            return 0.0
+    
+    def _get_process_cpu_percent(self, interval: float = 0.1) -> float:
+        """Get current process CPU usage percentage."""
+        if not self.enable_monitoring:
+            return 0.0
+        try:
+            process = psutil.Process()
+            return process.cpu_percent(interval=interval)
+        except Exception:
+            return 0.0
+    
+    def monitor_call(self, plugin_id: str, func: Callable, *args, **kwargs) -> Any:
+        """
+        Monitor a plugin method call.
+        
+        Tracks execution time and resource usage, enforces limits.
+        
+        Args:
+            plugin_id: Plugin identifier
+            func: Function to call
+            *args: Function arguments
+            **kwargs: Function keyword arguments
+        
+        Returns:
+            Function return value
+        
+        Raises:
+            ResourceLimitExceeded: If resource limits are exceeded
+        """
+        metrics = self.get_metrics(plugin_id)
+        limits = self.get_limits(plugin_id)
+        
+        # Record start time and memory
+        start_time = time.time()
+        start_memory = self._get_process_memory_mb()
+        
+        try:
+            # Execute the function
+            result = func(*args, **kwargs)
+            
+            # Calculate execution time
+            execution_time = time.time() - start_time
+            
+            # Update metrics
+            with self._lock:
+                metrics.execution_time = execution_time
+                metrics.call_count += 1
+                metrics.total_execution_time += execution_time
+                metrics.max_execution_time = max(metrics.max_execution_time, execution_time)
+                if metrics.min_execution_time == float('inf'):
+                    metrics.min_execution_time = execution_time
+                else:
+                    metrics.min_execution_time = min(metrics.min_execution_time, execution_time)
+                metrics.last_update_time = time.time()
+                
+                # Update memory and CPU if monitoring enabled
+                if self.enable_monitoring:
+                    end_memory = self._get_process_memory_mb()
+                    metrics.memory_mb = max(metrics.memory_mb, end_memory - start_memory)
+                    # CPU is harder to measure per-call, so we track it separately
+                    metrics.cpu_percent = self._get_process_cpu_percent()
+                
+                # Persist metrics
+                cache_key = self._get_metrics_key(plugin_id)
+                self.cache_manager.set(cache_key, {
+                    'memory_mb': metrics.memory_mb,
+                    'cpu_percent': metrics.cpu_percent,
+                    'execution_time': metrics.execution_time,
+                    'call_count': metrics.call_count,
+                    'total_execution_time': metrics.total_execution_time,
+                    'max_execution_time': metrics.max_execution_time,
+                    'min_execution_time': metrics.min_execution_time if metrics.min_execution_time != float('inf') else 0.0,
+                    'last_update_time': metrics.last_update_time
+                })
+            
+            # Check limits
+            if limits:
+                self._check_limits(plugin_id, metrics, limits, execution_time)
+            
+            return result
+            
+        except ResourceLimitExceeded:
+            raise
+        except Exception as e:
+            # Still record execution time even on error
+            execution_time = time.time() - start_time
+            with self._lock:
+                metrics.execution_time = execution_time
+                metrics.last_update_time = time.time()
+            raise
+    
+    def _check_limits(self, plugin_id: str, metrics: ResourceMetrics, 
+                     limits: ResourceLimits, execution_time: float) -> None:
+        """Check if plugin has exceeded resource limits."""
+        warnings = []
+        errors = []
+        
+        # Check execution time
+        if limits.max_execution_time and execution_time > limits.max_execution_time:
+            errors.append(
+                f"Execution time {execution_time:.2f}s exceeds limit {limits.max_execution_time:.2f}s"
+            )
+        elif limits.max_execution_time and execution_time > limits.max_execution_time * limits.warning_threshold:
+            warnings.append(
+                f"Execution time {execution_time:.2f}s approaching limit {limits.max_execution_time:.2f}s"
+            )
+        
+        # Check memory
+        if limits.max_memory_mb and metrics.memory_mb > limits.max_memory_mb:
+            errors.append(
+                f"Memory usage {metrics.memory_mb:.2f}MB exceeds limit {limits.max_memory_mb:.2f}MB"
+            )
+        elif limits.max_memory_mb and metrics.memory_mb > limits.max_memory_mb * limits.warning_threshold:
+            warnings.append(
+                f"Memory usage {metrics.memory_mb:.2f}MB approaching limit {limits.max_memory_mb:.2f}MB"
+            )
+        
+        # Check CPU
+        if limits.max_cpu_percent and metrics.cpu_percent > limits.max_cpu_percent:
+            errors.append(
+                f"CPU usage {metrics.cpu_percent:.2f}% exceeds limit {limits.max_cpu_percent:.2f}%"
+            )
+        elif limits.max_cpu_percent and metrics.cpu_percent > limits.max_cpu_percent * limits.warning_threshold:
+            warnings.append(
+                f"CPU usage {metrics.cpu_percent:.2f}% approaching limit {limits.max_cpu_percent:.2f}%"
+            )
+        
+        # Log warnings
+        for warning in warnings:
+            self.logger.warning(f"Plugin {plugin_id}: {warning}")
+        
+        # Raise exception for errors
+        if errors:
+            error_msg = f"Plugin {plugin_id} exceeded resource limits: {'; '.join(errors)}"
+            self.logger.error(error_msg)
+            raise ResourceLimitExceeded(error_msg)
+    
+    def get_metrics_summary(self, plugin_id: str) -> Dict[str, Any]:
+        """Get metrics summary for a plugin."""
+        metrics = self.get_metrics(plugin_id)
+        limits = self.get_limits(plugin_id)
+        
+        avg_execution_time = 0.0
+        if metrics.call_count > 0:
+            avg_execution_time = metrics.total_execution_time / metrics.call_count
+        
+        summary = {
+            'plugin_id': plugin_id,
+            'memory_mb': round(metrics.memory_mb, 2),
+            'cpu_percent': round(metrics.cpu_percent, 2),
+            'execution_time': round(metrics.execution_time, 3),
+            'avg_execution_time': round(avg_execution_time, 3),
+            'min_execution_time': round(metrics.min_execution_time if metrics.min_execution_time != float('inf') else 0.0, 3),
+            'max_execution_time': round(metrics.max_execution_time, 3),
+            'call_count': metrics.call_count,
+            'last_update_time': metrics.last_update_time
+        }
+        
+        if limits:
+            summary['limits'] = {
+                'max_memory_mb': limits.max_memory_mb,
+                'max_cpu_percent': limits.max_cpu_percent,
+                'max_execution_time': limits.max_execution_time,
+                'warning_threshold': limits.warning_threshold
+            }
+            
+            # Calculate usage percentages
+            if limits.max_memory_mb:
+                summary['memory_usage_percent'] = round(
+                    (metrics.memory_mb / limits.max_memory_mb) * 100, 2
+                )
+            if limits.max_cpu_percent:
+                summary['cpu_usage_percent'] = round(
+                    (metrics.cpu_percent / limits.max_cpu_percent) * 100, 2
+                )
+            if limits.max_execution_time:
+                summary['execution_time_usage_percent'] = round(
+                    (avg_execution_time / limits.max_execution_time) * 100, 2
+                )
+        
+        return summary
+    
+    def get_all_metrics_summaries(self) -> Dict[str, Dict[str, Any]]:
+        """Get metrics summaries for all tracked plugins."""
+        summaries = {}
+        for plugin_id in self._metrics.keys():
+            summaries[plugin_id] = self.get_metrics_summary(plugin_id)
+        return summaries
+    
+    def reset_metrics(self, plugin_id: str) -> None:
+        """Reset metrics for a plugin."""
+        with self._lock:
+            if plugin_id in self._metrics:
+                self._metrics[plugin_id] = ResourceMetrics()
+                cache_key = self._get_metrics_key(plugin_id)
+                self.cache_manager.delete(cache_key)
+

src/plugin_system/saved_repositories.py

@@ -0,0 +1,132 @@
+"""
+Saved Repositories Manager for LEDMatrix
+
+Manages saved GitHub repository URLs for easy plugin discovery and installation.
+"""
+
+import json
+import os
+import logging
+from pathlib import Path
+from typing import List, Dict, Optional
+
+
+class SavedRepositoriesManager:
+    """Manages saved GitHub repository URLs."""
+    
+    def __init__(self, config_path: str = "config/saved_repositories.json"):
+        """
+        Initialize the saved repositories manager.
+        
+        Args:
+            config_path: Path to JSON file storing saved repositories
+        """
+        self.config_path = Path(config_path)
+        self.logger = logging.getLogger(__name__)
+        self.repositories = self._load_repositories()
+    
+    def _load_repositories(self) -> List[Dict[str, str]]:
+        """Load saved repositories from file."""
+        try:
+            if self.config_path.exists():
+                with open(self.config_path, 'r') as f:
+                    data = json.load(f)
+                    # Ensure it's a list
+                    if isinstance(data, list):
+                        return data
+                    elif isinstance(data, dict) and 'repositories' in data:
+                        return data['repositories']
+                    else:
+                        return []
+            return []
+        except Exception as e:
+            self.logger.error(f"Error loading saved repositories: {e}")
+            return []
+    
+    def _save_repositories(self) -> bool:
+        """Save repositories to file."""
+        try:
+            # Ensure directory exists
+            self.config_path.parent.mkdir(parents=True, exist_ok=True)
+            
+            with open(self.config_path, 'w') as f:
+                json.dump(self.repositories, f, indent=2)
+            
+            self.logger.info(f"Saved {len(self.repositories)} repositories to {self.config_path}")
+            return True
+        except Exception as e:
+            self.logger.error(f"Error saving repositories: {e}")
+            return False
+    
+    def get_all(self) -> List[Dict[str, str]]:
+        """Get all saved repositories."""
+        return self.repositories.copy()
+    
+    def add(self, repo_url: str, name: Optional[str] = None) -> bool:
+        """
+        Add a repository to saved list.
+        
+        Args:
+            repo_url: GitHub repository URL
+            name: Optional friendly name for the repository
+            
+        Returns:
+            True if added successfully
+        """
+        # Clean URL
+        repo_url = repo_url.strip().rstrip('/').replace('.git', '')
+        
+        # Check if already exists
+        for repo in self.repositories:
+            if repo.get('url') == repo_url:
+                self.logger.warning(f"Repository already exists: {repo_url}")
+                return False
+        
+        # Extract name from URL if not provided
+        if not name:
+            parts = repo_url.split('/')
+            if len(parts) >= 2:
+                name = parts[-1]
+            else:
+                name = repo_url
+        
+        # Add repository
+        self.repositories.append({
+            'url': repo_url,
+            'name': name,
+            'type': 'registry' if 'plugins.json' in repo_url or 'ledmatrix-plugins' in repo_url.lower() else 'single'
+        })
+        
+        return self._save_repositories()
+    
+    def remove(self, repo_url: str) -> bool:
+        """
+        Remove a repository from saved list.
+        
+        Args:
+            repo_url: GitHub repository URL to remove
+            
+        Returns:
+            True if removed successfully
+        """
+        # Clean URL
+        repo_url = repo_url.strip().rstrip('/').replace('.git', '')
+        
+        original_count = len(self.repositories)
+        self.repositories = [r for r in self.repositories if r.get('url') != repo_url]
+        
+        if len(self.repositories) < original_count:
+            return self._save_repositories()
+        else:
+            self.logger.warning(f"Repository not found: {repo_url}")
+            return False
+    
+    def has(self, repo_url: str) -> bool:
+        """Check if a repository is already saved."""
+        repo_url = repo_url.strip().rstrip('/').replace('.git', '')
+        return any(r.get('url') == repo_url for r in self.repositories)
+    
+    def get_registry_repositories(self) -> List[Dict[str, str]]:
+        """Get only registry-style repositories."""
+        return [r for r in self.repositories if r.get('type') == 'registry']
+

src/plugin_system/schema_manager.py

@@ -0,0 +1,417 @@
+"""
+Schema Manager
+
+Manages plugin configuration schemas with caching, validation, and reliable path resolution.
+Provides utilities for extracting defaults, validating configurations, and managing schema lifecycle.
+"""
+
+import copy
+import json
+import logging
+import os
+from pathlib import Path
+from typing import Any, Dict, List, Optional, Tuple
+import jsonschema
+from jsonschema import Draft7Validator, ValidationError
+
+
+class SchemaManager:
+    """
+    Manages plugin configuration schemas with caching and validation.
+    
+    Features:
+    - Schema loading and caching
+    - Default value extraction from schemas
+    - Configuration validation against schemas
+    - Reliable path resolution for schema files
+    - Cache invalidation on plugin changes
+    """
+    
+    def __init__(self, plugins_dir: Optional[Path] = None, project_root: Optional[Path] = None, logger: Optional[logging.Logger] = None):
+        """
+        Initialize the Schema Manager.
+        
+        Args:
+            plugins_dir: Base plugins directory path
+            project_root: Project root directory path
+            logger: Optional logger instance
+        """
+        self.logger = logger or logging.getLogger(__name__)
+        self.plugins_dir = plugins_dir
+        self.project_root = project_root or Path.cwd()
+        
+        # Schema cache: plugin_id -> schema dict
+        self._schema_cache: Dict[str, Dict[str, Any]] = {}
+        
+        # Default config cache: plugin_id -> default config dict
+        self._defaults_cache: Dict[str, Dict[str, Any]] = {}
+    
+    def get_schema_path(self, plugin_id: str) -> Optional[Path]:
+        """
+        Get the path to a plugin's config_schema.json file.
+        
+        Tries multiple locations in order:
+        1. plugins_dir / plugin_id / config_schema.json
+        2. PROJECT_ROOT / plugins / plugin_id / config_schema.json
+        3. PROJECT_ROOT / plugin-repos / plugin_id / config_schema.json
+        
+        Args:
+            plugin_id: Plugin identifier
+            
+        Returns:
+            Path to schema file or None if not found
+        """
+        possible_paths = []
+        
+        # Try plugins_dir if set
+        if self.plugins_dir:
+            possible_paths.append(self.plugins_dir / plugin_id / 'config_schema.json')
+        
+        # Try standard locations relative to project root
+        possible_paths.extend([
+            self.project_root / 'plugins' / plugin_id / 'config_schema.json',
+            self.project_root / 'plugin-repos' / plugin_id / 'config_schema.json',
+        ])
+        
+        # Try case-insensitive directory matching
+        for base_dir in [self.project_root / 'plugins', self.project_root / 'plugin-repos']:
+            if base_dir.exists():
+                for item in base_dir.iterdir():
+                    if item.is_dir() and item.name.lower() == plugin_id.lower():
+                        possible_paths.append(item / 'config_schema.json')
+        
+        # Try each path
+        for path in possible_paths:
+            if path.exists():
+                self.logger.debug(f"Found schema for {plugin_id} at {path}")
+                return path
+        
+        self.logger.warning(f"Schema file not found for plugin {plugin_id}")
+        return None
+    
+    def load_schema(self, plugin_id: str, use_cache: bool = True) -> Optional[Dict[str, Any]]:
+        """
+        Load a plugin's configuration schema.
+        
+        Args:
+            plugin_id: Plugin identifier
+            use_cache: If True, return cached schema if available
+            
+        Returns:
+            Schema dictionary or None if not found
+        """
+        # Check cache first
+        if use_cache and plugin_id in self._schema_cache:
+            return self._schema_cache[plugin_id]
+        
+        schema_path = self.get_schema_path(plugin_id)
+        if not schema_path:
+            return None
+        
+        try:
+            with open(schema_path, 'r', encoding='utf-8') as f:
+                schema = json.load(f)
+            
+            # Validate schema structure (basic check)
+            if not isinstance(schema, dict):
+                self.logger.error(f"Invalid schema format for {plugin_id}: not a dictionary")
+                return None
+            
+            # Cache the schema
+            self._schema_cache[plugin_id] = schema
+            
+            # Invalidate defaults cache when schema changes
+            if plugin_id in self._defaults_cache:
+                del self._defaults_cache[plugin_id]
+            
+            return schema
+            
+        except json.JSONDecodeError as e:
+            self.logger.error(f"Invalid JSON in schema file for {plugin_id}: {e}")
+            return None
+        except Exception as e:
+            self.logger.error(f"Error loading schema for {plugin_id}: {e}")
+            return None
+    
+    def invalidate_cache(self, plugin_id: Optional[str] = None) -> None:
+        """
+        Invalidate schema cache for a plugin or all plugins.
+        
+        Args:
+            plugin_id: Plugin identifier to invalidate, or None to clear all
+        """
+        if plugin_id:
+            self._schema_cache.pop(plugin_id, None)
+            self._defaults_cache.pop(plugin_id, None)
+            self.logger.debug(f"Invalidated cache for plugin {plugin_id}")
+        else:
+            self._schema_cache.clear()
+            self._defaults_cache.clear()
+            self.logger.debug("Invalidated all schema caches")
+    
+    def extract_defaults_from_schema(self, schema: Dict[str, Any], prefix: str = '') -> Dict[str, Any]:
+        """
+        Recursively extract default values from a JSON Schema.
+        
+        Handles nested objects, arrays, and all schema types.
+        
+        Args:
+            schema: JSON Schema dictionary
+            prefix: Optional prefix for logging/debugging
+            
+        Returns:
+            Dictionary of default values
+        """
+        defaults = {}
+        
+        # Handle schema with properties
+        properties = schema.get('properties', {})
+        if not properties:
+            return defaults
+        
+        for key, prop_schema in properties.items():
+            field_path = f"{prefix}.{key}" if prefix else key
+            
+            # If property has a default, use it
+            if 'default' in prop_schema:
+                defaults[key] = prop_schema['default']
+                self.logger.debug(f"Found default for {field_path}: {prop_schema['default']}")
+                continue
+            
+            # Handle nested objects
+            if prop_schema.get('type') == 'object' and 'properties' in prop_schema:
+                nested_defaults = self.extract_defaults_from_schema(prop_schema, field_path)
+                if nested_defaults:
+                    defaults[key] = nested_defaults
+            
+            # Handle arrays with object items
+            elif prop_schema.get('type') == 'array' and 'items' in prop_schema:
+                items_schema = prop_schema['items']
+                if items_schema.get('type') == 'object' and 'properties' in items_schema:
+                    # For arrays of objects, use empty array as default
+                    # Individual objects will use their defaults when created
+                    defaults[key] = []
+                elif 'default' in items_schema:
+                    # Array with default item value
+                    defaults[key] = [items_schema['default']]
+                else:
+                    # Empty array as default
+                    defaults[key] = []
+            
+            # For other types without defaults, don't add to defaults dict
+            # This allows plugins to handle missing values as needed
+        
+        return defaults
+    
+    def generate_default_config(self, plugin_id: str, use_cache: bool = True) -> Dict[str, Any]:
+        """
+        Generate default configuration for a plugin from its schema.
+        
+        Args:
+            plugin_id: Plugin identifier
+            use_cache: If True, return cached defaults if available
+            
+        Returns:
+            Dictionary of default configuration values
+        """
+        # Check cache first
+        if use_cache and plugin_id in self._defaults_cache:
+            return self._defaults_cache[plugin_id].copy()
+        
+        schema = self.load_schema(plugin_id, use_cache=use_cache)
+        if not schema:
+            # Return minimal defaults if no schema
+            return {
+                'enabled': False,
+                'display_duration': 15
+            }
+        
+        # Extract defaults from schema
+        defaults = self.extract_defaults_from_schema(schema)
+        
+        # Ensure core properties have defaults (they may not be in the schema)
+        # These match BasePlugin behavior
+        if 'enabled' not in defaults:
+            defaults['enabled'] = schema.get('properties', {}).get('enabled', {}).get('default', True)
+        
+        if 'display_duration' not in defaults:
+            defaults['display_duration'] = schema.get('properties', {}).get('display_duration', {}).get('default', 15)
+        
+        if 'live_priority' not in defaults:
+            defaults['live_priority'] = schema.get('properties', {}).get('live_priority', {}).get('default', False)
+        
+        # Cache the defaults
+        self._defaults_cache[plugin_id] = defaults.copy()
+        
+        return defaults
+    
+    def validate_config_against_schema(self, config: Dict[str, Any], schema: Dict[str, Any], 
+                                      plugin_id: Optional[str] = None) -> Tuple[bool, List[str]]:
+        """
+        Validate configuration against a JSON Schema.
+        
+        Uses jsonschema library for comprehensive validation.
+        Automatically injects core plugin properties (enabled, display_duration, etc.)
+        into the schema before validation to ensure they're always allowed.
+        
+        Args:
+            config: Configuration dictionary to validate
+            schema: JSON Schema dictionary
+            plugin_id: Optional plugin ID for error messages
+            
+        Returns:
+            Tuple of (is_valid, list_of_error_messages)
+        """
+        errors = []
+        
+        try:
+            # Core plugin properties that should always be allowed
+            # These are handled by the base plugin system and should not cause validation failures
+            # Defaults match BasePlugin behavior: enabled=True, display_duration=15, live_priority=False
+            core_properties = {
+                "enabled": {
+                    "type": "boolean",
+                    "default": True,
+                    "description": "Enable or disable this plugin"
+                },
+                "display_duration": {
+                    "type": "number",
+                    "default": 15,
+                    "minimum": 1,
+                    "maximum": 300,
+                    "description": "How long to display this plugin in seconds"
+                },
+                "live_priority": {
+                    "type": "boolean",
+                    "default": False,
+                    "description": "Enable live priority takeover when plugin has live content"
+                }
+            }
+            
+            # Create a deep copy of the schema to modify (to avoid mutating the original)
+            enhanced_schema = copy.deepcopy(schema)
+            if "properties" not in enhanced_schema:
+                enhanced_schema["properties"] = {}
+            
+            # Inject core properties if they're not already defined in the schema
+            # This ensures core properties are always allowed even if not in the plugin's schema
+            properties_added = []
+            for prop_name, prop_def in core_properties.items():
+                if prop_name not in enhanced_schema["properties"]:
+                    enhanced_schema["properties"][prop_name] = copy.deepcopy(prop_def)
+                    properties_added.append(prop_name)
+            
+            # Log if we added any core properties (for debugging)
+            if properties_added and plugin_id:
+                self.logger.debug(
+                    f"Injected core properties into schema for {plugin_id}: {properties_added}"
+                )
+            
+            # Remove core properties from required array (they're system-managed)
+            # Core properties should be allowed but not required for validation
+            if "required" in enhanced_schema:
+                core_prop_names = list(core_properties.keys())
+                removed_from_required = [
+                    field for field in enhanced_schema["required"]
+                    if field in core_prop_names
+                ]
+                enhanced_schema["required"] = [
+                    field for field in enhanced_schema["required"] 
+                    if field not in core_prop_names
+                ]
+                
+                # Log if we removed any core properties from required (for debugging)
+                if removed_from_required and plugin_id:
+                    self.logger.debug(
+                        f"Removed core properties from required array for {plugin_id}: {removed_from_required}"
+                    )
+            
+            # Create validator with enhanced schema
+            validator = Draft7Validator(enhanced_schema)
+            
+            # Collect all validation errors
+            for error in validator.iter_errors(config):
+                error_msg = self._format_validation_error(error, plugin_id)
+                errors.append(error_msg)
+            
+            # Check required fields
+            required_fields = enhanced_schema.get('required', [])
+            for field in required_fields:
+                if field not in config:
+                    errors.append(f"Missing required field: '{field}'")
+            
+            if errors:
+                return False, errors
+            
+            return True, []
+            
+        except jsonschema.SchemaError as e:
+            error_msg = f"Schema error{' for ' + plugin_id if plugin_id else ''}: {str(e)}"
+            self.logger.error(error_msg)
+            return False, [error_msg]
+        
+        except Exception as e:
+            error_msg = f"Validation error{' for ' + plugin_id if plugin_id else ''}: {str(e)}"
+            self.logger.error(error_msg)
+            return False, [error_msg]
+    
+    def _format_validation_error(self, error: ValidationError, plugin_id: Optional[str] = None) -> str:
+        """
+        Format a validation error into a readable message.
+        
+        Args:
+            error: ValidationError from jsonschema
+            plugin_id: Optional plugin ID for context
+            
+        Returns:
+            Formatted error message
+        """
+        path = '.'.join(str(p) for p in error.path)
+        field_path = f"'{path}'" if path else "root"
+        
+        if error.validator == 'required':
+            missing = error.validator_value
+            return f"Field {field_path}: Missing required property '{missing}'"
+        elif error.validator == 'type':
+            expected = error.validator_value
+            actual = type(error.instance).__name__
+            return f"Field {field_path}: Expected type {expected}, got {actual}"
+        elif error.validator == 'enum':
+            allowed = error.validator_value
+            return f"Field {field_path}: Value '{error.instance}' not in allowed values {allowed}"
+        elif error.validator in ['minimum', 'maximum']:
+            limit = error.validator_value
+            return f"Field {field_path}: Value {error.instance} violates {error.validator} constraint ({limit})"
+        elif error.validator in ['minLength', 'maxLength']:
+            limit = error.validator_value
+            return f"Field {field_path}: Length {len(error.instance)} violates {error.validator} constraint ({limit})"
+        elif error.validator in ['minItems', 'maxItems']:
+            limit = error.validator_value
+            return f"Field {field_path}: Array length {len(error.instance)} violates {error.validator} constraint ({limit})"
+        else:
+            return f"Field {field_path}: {error.message}"
+    
+    def merge_with_defaults(self, config: Dict[str, Any], defaults: Dict[str, Any]) -> Dict[str, Any]:
+        """
+        Merge configuration with defaults, preserving user values.
+        
+        Args:
+            config: User configuration
+            defaults: Default values from schema
+            
+        Returns:
+            Merged configuration with defaults applied where missing
+        """
+        merged = defaults.copy()
+        
+        def deep_merge(target: Dict[str, Any], source: Dict[str, Any]) -> None:
+            """Recursively merge source into target."""
+            for key, value in source.items():
+                if key in target and isinstance(target[key], dict) and isinstance(value, dict):
+                    deep_merge(target[key], value)
+                else:
+                    target[key] = value
+        
+        deep_merge(merged, config)
+        return merged
+

src/plugin_system/state_manager.py

@@ -0,0 +1,437 @@
+"""
+Centralized plugin state management.
+
+Provides a single source of truth for plugin state (installed, enabled, version, etc.)
+with state change events and persistence.
+"""
+
+import json
+import threading
+from typing import Dict, Any, Optional, List, Callable
+from pathlib import Path
+from datetime import datetime
+from dataclasses import dataclass, asdict
+from enum import Enum
+
+from src.logging_config import get_logger
+
+
+class PluginStateStatus(Enum):
+    """Status of a plugin."""
+    INSTALLED = "installed"
+    ENABLED = "enabled"
+    DISABLED = "disabled"
+    ERROR = "error"
+    UNKNOWN = "unknown"
+
+
+@dataclass
+class PluginState:
+    """Represents the state of a plugin."""
+    plugin_id: str
+    status: PluginStateStatus
+    enabled: bool
+    version: Optional[str] = None
+    installed_at: Optional[datetime] = None
+    last_updated: Optional[datetime] = None
+    config_version: int = 1  # For detecting state corruption
+    metadata: Dict[str, Any] = None
+    
+    def __post_init__(self):
+        if self.metadata is None:
+            self.metadata = {}
+    
+    def to_dict(self) -> Dict[str, Any]:
+        """Convert state to dictionary for serialization."""
+        result = asdict(self)
+        # Convert enum to string
+        result['status'] = self.status.value
+        # Convert datetime to ISO string
+        if result.get('installed_at'):
+            result['installed_at'] = self.installed_at.isoformat()
+        if result.get('last_updated'):
+            result['last_updated'] = self.last_updated.isoformat()
+        return result
+    
+    @classmethod
+    def from_dict(cls, data: Dict[str, Any]) -> 'PluginState':
+        """Create state from dictionary."""
+        # Parse enum
+        if isinstance(data.get('status'), str):
+            data['status'] = PluginStateStatus(data['status'])
+        
+        # Parse datetime
+        if data.get('installed_at') and isinstance(data['installed_at'], str):
+            data['installed_at'] = datetime.fromisoformat(data['installed_at'])
+        if data.get('last_updated') and isinstance(data['last_updated'], str):
+            data['last_updated'] = datetime.fromisoformat(data['last_updated'])
+        
+        return cls(**data)
+
+
+class PluginStateManager:
+    """
+    Centralized plugin state manager.
+    
+    Provides:
+    - Single source of truth for plugin state
+    - State change events/notifications
+    - State persistence
+    - State versioning
+    """
+    
+    def __init__(
+        self,
+        state_file: Optional[str] = None,
+        auto_save: bool = True,
+        lazy_load: bool = False
+    ):
+        """
+        Initialize state manager.
+        
+        Args:
+            state_file: Path to file for persisting state
+            auto_save: Whether to automatically save state on changes
+            lazy_load: If True, defer loading state file until first access
+        """
+        self.logger = get_logger(__name__)
+        self.state_file = Path(state_file) if state_file else None
+        self.auto_save = auto_save
+        self._lazy_load = lazy_load
+        self._state_loaded = False
+        
+        # State storage
+        self._states: Dict[str, PluginState] = {}
+        self._state_version = 1
+        
+        # State change callbacks
+        self._callbacks: Dict[str, List[Callable[[str, PluginState, PluginState], None]]] = {}
+        
+        # Threading
+        self._lock = threading.RLock()
+        
+        # Load state from file if it exists (unless lazy loading)
+        if not self._lazy_load and self.state_file and self.state_file.exists():
+            self._load_state()
+            self._state_loaded = True
+    
+    def _ensure_loaded(self) -> None:
+        """Ensure state is loaded (for lazy loading)."""
+        if not self._state_loaded and self.state_file and self.state_file.exists():
+            self._load_state()
+            self._state_loaded = True
+    
+    def get_plugin_state(self, plugin_id: str) -> Optional[PluginState]:
+        """
+        Get state for a plugin.
+        
+        Args:
+            plugin_id: Plugin identifier
+        
+        Returns:
+            PluginState if found, None otherwise
+        """
+        self._ensure_loaded()
+        with self._lock:
+            return self._states.get(plugin_id)
+    
+    def get_all_states(self) -> Dict[str, PluginState]:
+        """
+        Get all plugin states.
+        
+        Returns:
+            Dictionary mapping plugin_id to PluginState
+        """
+        self._ensure_loaded()
+        with self._lock:
+            return self._states.copy()
+    
+    def update_plugin_state(
+        self,
+        plugin_id: str,
+        updates: Dict[str, Any],
+        notify: bool = True
+    ) -> bool:
+        """
+        Update plugin state.
+        
+        Args:
+            plugin_id: Plugin identifier
+            updates: Dictionary of state updates
+            notify: Whether to notify callbacks of changes
+        
+        Returns:
+            True if update successful
+        """
+        self._ensure_loaded()
+        with self._lock:
+            # Get current state or create new
+            current_state = self._states.get(plugin_id)
+            if not current_state:
+                current_state = PluginState(
+                    plugin_id=plugin_id,
+                    status=PluginStateStatus.UNKNOWN,
+                    enabled=False
+                )
+            
+            # Create new state with updates
+            old_state = PluginState(
+                plugin_id=current_state.plugin_id,
+                status=current_state.status,
+                enabled=current_state.enabled,
+                version=current_state.version,
+                installed_at=current_state.installed_at,
+                last_updated=current_state.last_updated,
+                config_version=current_state.config_version,
+                metadata=current_state.metadata.copy() if current_state.metadata else {}
+            )
+            
+            # Apply updates
+            if 'status' in updates:
+                if isinstance(updates['status'], str):
+                    current_state.status = PluginStateStatus(updates['status'])
+                else:
+                    current_state.status = updates['status']
+            
+            if 'enabled' in updates:
+                current_state.enabled = bool(updates['enabled'])
+            
+            if 'version' in updates:
+                current_state.version = updates['version']
+            
+            if 'installed_at' in updates:
+                current_state.installed_at = updates['installed_at']
+            
+            if 'last_updated' in updates:
+                current_state.last_updated = updates['last_updated']
+            else:
+                current_state.last_updated = datetime.now()
+            
+            if 'metadata' in updates:
+                if current_state.metadata is None:
+                    current_state.metadata = {}
+                current_state.metadata.update(updates['metadata'])
+            
+            # Increment config version
+            current_state.config_version += 1
+            
+            # Store updated state
+            self._states[plugin_id] = current_state
+            
+            # Notify callbacks
+            if notify:
+                self._notify_callbacks(plugin_id, old_state, current_state)
+            
+            # Auto-save if enabled
+            if self.auto_save:
+                self._save_state()
+            
+            return True
+    
+    def set_plugin_enabled(self, plugin_id: str, enabled: bool) -> bool:
+        """
+        Set plugin enabled/disabled state.
+        
+        Args:
+            plugin_id: Plugin identifier
+            enabled: Whether plugin is enabled
+        
+        Returns:
+            True if update successful
+        """
+        status = PluginStateStatus.ENABLED if enabled else PluginStateStatus.DISABLED
+        return self.update_plugin_state(
+            plugin_id,
+            {
+                'enabled': enabled,
+                'status': status
+            }
+        )
+    
+    def set_plugin_installed(
+        self,
+        plugin_id: str,
+        version: Optional[str] = None,
+        installed_at: Optional[datetime] = None
+    ) -> bool:
+        """
+        Mark plugin as installed.
+        
+        Args:
+            plugin_id: Plugin identifier
+            version: Plugin version
+            installed_at: Installation timestamp
+        
+        Returns:
+            True if update successful
+        """
+        return self.update_plugin_state(
+            plugin_id,
+            {
+                'status': PluginStateStatus.INSTALLED,
+                'version': version,
+                'installed_at': installed_at or datetime.now()
+            }
+        )
+    
+    def set_plugin_error(self, plugin_id: str, error: Optional[str] = None) -> bool:
+        """
+        Mark plugin as having an error.
+        
+        Args:
+            plugin_id: Plugin identifier
+            error: Optional error message
+        
+        Returns:
+            True if update successful
+        """
+        updates = {'status': PluginStateStatus.ERROR}
+        if error:
+            updates['metadata'] = {'last_error': error}
+        
+        return self.update_plugin_state(plugin_id, updates)
+    
+    def remove_plugin_state(self, plugin_id: str) -> bool:
+        """
+        Remove plugin state (e.g., after uninstall).
+        
+        Args:
+            plugin_id: Plugin identifier
+        
+        Returns:
+            True if removal successful
+        """
+        self._ensure_loaded()
+        with self._lock:
+            if plugin_id in self._states:
+                old_state = self._states[plugin_id]
+                del self._states[plugin_id]
+                
+                # Notify callbacks
+                self._notify_callbacks(plugin_id, old_state, None)
+                
+                # Auto-save if enabled
+                if self.auto_save:
+                    self._save_state()
+                
+                return True
+        
+        return False
+    
+    def subscribe_to_state_changes(
+        self,
+        callback: Callable[[str, PluginState, Optional[PluginState]], None],
+        plugin_id: Optional[str] = None
+    ) -> str:
+        """
+        Subscribe to state changes.
+        
+        Args:
+            callback: Callback function (plugin_id, old_state, new_state)
+            plugin_id: Optional plugin ID to filter on (None = all plugins)
+        
+        Returns:
+            Subscription ID
+        """
+        import uuid
+        subscription_id = str(uuid.uuid4())
+        
+        with self._lock:
+            key = plugin_id or '*'
+            if key not in self._callbacks:
+                self._callbacks[key] = []
+            self._callbacks[key].append(callback)
+        
+        return subscription_id
+    
+    def _notify_callbacks(
+        self,
+        plugin_id: str,
+        old_state: PluginState,
+        new_state: Optional[PluginState]
+    ) -> None:
+        """Notify all relevant callbacks of state change."""
+        # Get callbacks for this plugin and all plugins
+        callbacks_to_notify = []
+        
+        if plugin_id in self._callbacks:
+            callbacks_to_notify.extend(self._callbacks[plugin_id])
+        
+        if '*' in self._callbacks:
+            callbacks_to_notify.extend(self._callbacks['*'])
+        
+        # Call each callback
+        for callback in callbacks_to_notify:
+            try:
+                callback(plugin_id, old_state, new_state)
+            except Exception as e:
+                self.logger.error(
+                    f"Error in state change callback: {e}",
+                    exc_info=True
+                )
+    
+    def _save_state(self) -> None:
+        """Save state to file."""
+        if not self.state_file:
+            return
+        
+        try:
+            with self._lock:
+                # Convert states to dicts
+                states_data = {
+                    plugin_id: state.to_dict()
+                    for plugin_id, state in self._states.items()
+                }
+                
+                state_data = {
+                    'version': self._state_version,
+                    'states': states_data,
+                    'last_updated': datetime.now().isoformat()
+                }
+            
+            # Ensure directory exists with proper permissions
+            from src.common.permission_utils import (
+                ensure_directory_permissions,
+                get_config_dir_mode
+            )
+            ensure_directory_permissions(self.state_file.parent, get_config_dir_mode())
+            
+            # Write to file
+            with open(self.state_file, 'w') as f:
+                json.dump(state_data, f, indent=2)
+            
+        except Exception as e:
+            self.logger.error(f"Error saving plugin state: {e}", exc_info=True)
+    
+    def _load_state(self) -> None:
+        """Load state from file."""
+        if not self.state_file or not self.state_file.exists():
+            return
+        
+        try:
+            with open(self.state_file, 'r') as f:
+                state_data = json.load(f)
+            
+            with self._lock:
+                # Load state version
+                self._state_version = state_data.get('version', 1)
+                
+                # Load states
+                states_data = state_data.get('states', {})
+                for plugin_id, state_dict in states_data.items():
+                    try:
+                        self._states[plugin_id] = PluginState.from_dict(state_dict)
+                    except Exception as e:
+                        self.logger.warning(
+                            f"Error loading state for plugin {plugin_id}: {e}"
+                        )
+            
+            self.logger.info(f"Loaded {len(self._states)} plugin states from file")
+            
+        except Exception as e:
+            self.logger.error(f"Error loading plugin state: {e}", exc_info=True)
+    
+    def get_state_version(self) -> int:
+        """Get current state version (for detecting corruption)."""
+        return self._state_version
+

src/plugin_system/state_reconciliation.py

@@ -0,0 +1,322 @@
+"""
+State reconciliation system.
+
+Detects and fixes inconsistencies between:
+- Config file state
+- Plugin manager state
+- Disk state (installed plugins)
+- State manager state
+"""
+
+from typing import Dict, Any, List, Optional
+from dataclasses import dataclass
+from enum import Enum
+from pathlib import Path
+
+from src.plugin_system.state_manager import PluginStateManager, PluginState, PluginStateStatus
+from src.logging_config import get_logger
+
+
+class InconsistencyType(Enum):
+    """Types of state inconsistencies."""
+    PLUGIN_MISSING_IN_CONFIG = "plugin_missing_in_config"
+    PLUGIN_MISSING_ON_DISK = "plugin_missing_on_disk"
+    PLUGIN_ENABLED_MISMATCH = "plugin_enabled_mismatch"
+    PLUGIN_VERSION_MISMATCH = "plugin_version_mismatch"
+    PLUGIN_STATE_CORRUPTED = "plugin_state_corrupted"
+
+
+class FixAction(Enum):
+    """Actions that can be taken to fix inconsistencies."""
+    AUTO_FIX = "auto_fix"
+    MANUAL_FIX_REQUIRED = "manual_fix_required"
+    NO_ACTION = "no_action"
+
+
+@dataclass
+class Inconsistency:
+    """Represents a state inconsistency."""
+    plugin_id: str
+    inconsistency_type: InconsistencyType
+    description: str
+    fix_action: FixAction
+    current_state: Dict[str, Any]
+    expected_state: Dict[str, Any]
+    can_auto_fix: bool = False
+
+
+@dataclass
+class ReconciliationResult:
+    """Result of state reconciliation."""
+    inconsistencies_found: List[Inconsistency]
+    inconsistencies_fixed: List[Inconsistency]
+    inconsistencies_manual: List[Inconsistency]
+    reconciliation_successful: bool
+    message: str
+
+
+class StateReconciliation:
+    """
+    State reconciliation system.
+    
+    Compares state from multiple sources and detects/fixes inconsistencies.
+    """
+    
+    def __init__(
+        self,
+        state_manager: PluginStateManager,
+        config_manager,
+        plugin_manager,
+        plugins_dir: Path
+    ):
+        """
+        Initialize reconciliation system.
+        
+        Args:
+            state_manager: PluginStateManager instance
+            config_manager: ConfigManager instance
+            plugin_manager: PluginManager instance
+            plugins_dir: Path to plugins directory
+        """
+        self.state_manager = state_manager
+        self.config_manager = config_manager
+        self.plugin_manager = plugin_manager
+        self.plugins_dir = Path(plugins_dir)
+        self.logger = get_logger(__name__)
+    
+    def reconcile_state(self) -> ReconciliationResult:
+        """
+        Perform state reconciliation.
+        
+        Compares state from all sources and fixes safe inconsistencies.
+        
+        Returns:
+            ReconciliationResult with findings and fixes
+        """
+        self.logger.info("Starting state reconciliation")
+        
+        inconsistencies = []
+        fixed = []
+        manual_fix_required = []
+        
+        try:
+            # Get state from all sources
+            config_state = self._get_config_state()
+            disk_state = self._get_disk_state()
+            manager_state = self._get_manager_state()
+            state_manager_state = self._get_state_manager_state()
+            
+            # Find all unique plugin IDs
+            all_plugin_ids = set()
+            all_plugin_ids.update(config_state.keys())
+            all_plugin_ids.update(disk_state.keys())
+            all_plugin_ids.update(manager_state.keys())
+            all_plugin_ids.update(state_manager_state.keys())
+            
+            # Check each plugin for inconsistencies
+            for plugin_id in all_plugin_ids:
+                plugin_inconsistencies = self._check_plugin_consistency(
+                    plugin_id,
+                    config_state,
+                    disk_state,
+                    manager_state,
+                    state_manager_state
+                )
+                inconsistencies.extend(plugin_inconsistencies)
+            
+            # Attempt to fix auto-fixable inconsistencies
+            for inconsistency in inconsistencies:
+                if inconsistency.can_auto_fix and inconsistency.fix_action == FixAction.AUTO_FIX:
+                    if self._fix_inconsistency(inconsistency):
+                        fixed.append(inconsistency)
+                    else:
+                        manual_fix_required.append(inconsistency)
+                elif inconsistency.fix_action == FixAction.MANUAL_FIX_REQUIRED:
+                    manual_fix_required.append(inconsistency)
+            
+            # Build result
+            success = len(manual_fix_required) == 0
+            
+            message = (
+                f"Reconciliation complete: {len(inconsistencies)} inconsistencies found, "
+                f"{len(fixed)} fixed automatically, {len(manual_fix_required)} require manual attention"
+            )
+            
+            return ReconciliationResult(
+                inconsistencies_found=inconsistencies,
+                inconsistencies_fixed=fixed,
+                inconsistencies_manual=manual_fix_required,
+                reconciliation_successful=success,
+                message=message
+            )
+            
+        except Exception as e:
+            self.logger.error(f"Error during state reconciliation: {e}", exc_info=True)
+            return ReconciliationResult(
+                inconsistencies_found=inconsistencies,
+                inconsistencies_fixed=fixed,
+                inconsistencies_manual=manual_fix_required,
+                reconciliation_successful=False,
+                message=f"Reconciliation failed: {str(e)}"
+            )
+    
+    def _get_config_state(self) -> Dict[str, Dict[str, Any]]:
+        """Get plugin state from config file."""
+        state = {}
+        try:
+            config = self.config_manager.load_config()
+            for plugin_id, plugin_config in config.items():
+                if isinstance(plugin_config, dict):
+                    state[plugin_id] = {
+                        'enabled': plugin_config.get('enabled', False),
+                        'version': plugin_config.get('version'),
+                        'exists_in_config': True
+                    }
+        except Exception as e:
+            self.logger.warning(f"Error reading config state: {e}")
+        return state
+    
+    def _get_disk_state(self) -> Dict[str, Dict[str, Any]]:
+        """Get plugin state from disk (installed plugins)."""
+        state = {}
+        try:
+            if self.plugins_dir.exists():
+                for plugin_dir in self.plugins_dir.iterdir():
+                    if plugin_dir.is_dir():
+                        plugin_id = plugin_dir.name
+                        manifest_path = plugin_dir / "manifest.json"
+                        if manifest_path.exists():
+                            import json
+                            try:
+                                with open(manifest_path, 'r') as f:
+                                    manifest = json.load(f)
+                                state[plugin_id] = {
+                                    'exists_on_disk': True,
+                                    'version': manifest.get('version'),
+                                    'name': manifest.get('name')
+                                }
+                            except Exception:
+                                pass
+        except Exception as e:
+            self.logger.warning(f"Error reading disk state: {e}")
+        return state
+    
+    def _get_manager_state(self) -> Dict[str, Dict[str, Any]]:
+        """Get plugin state from plugin manager."""
+        state = {}
+        try:
+            if self.plugin_manager:
+                # Get discovered plugins
+                if hasattr(self.plugin_manager, 'plugin_manifests'):
+                    for plugin_id in self.plugin_manager.plugin_manifests.keys():
+                        state[plugin_id] = {
+                            'exists_in_manager': True,
+                            'loaded': plugin_id in getattr(self.plugin_manager, 'plugins', {})
+                        }
+        except Exception as e:
+            self.logger.warning(f"Error reading manager state: {e}")
+        return state
+    
+    def _get_state_manager_state(self) -> Dict[str, Dict[str, Any]]:
+        """Get plugin state from state manager."""
+        state = {}
+        try:
+            all_states = self.state_manager.get_all_states()
+            for plugin_id, plugin_state in all_states.items():
+                state[plugin_id] = {
+                    'enabled': plugin_state.enabled,
+                    'status': plugin_state.status.value,
+                    'version': plugin_state.version,
+                    'exists_in_state_manager': True
+                }
+        except Exception as e:
+            self.logger.warning(f"Error reading state manager state: {e}")
+        return state
+    
+    def _check_plugin_consistency(
+        self,
+        plugin_id: str,
+        config_state: Dict[str, Dict[str, Any]],
+        disk_state: Dict[str, Dict[str, Any]],
+        manager_state: Dict[str, Dict[str, Any]],
+        state_manager_state: Dict[str, Dict[str, Any]]
+    ) -> List[Inconsistency]:
+        """Check consistency for a single plugin."""
+        inconsistencies = []
+        
+        config = config_state.get(plugin_id, {})
+        disk = disk_state.get(plugin_id, {})
+        manager = manager_state.get(plugin_id, {})
+        state_mgr = state_manager_state.get(plugin_id, {})
+        
+        # Check: Plugin exists on disk but not in config
+        if disk.get('exists_on_disk') and not config.get('exists_in_config'):
+            inconsistencies.append(Inconsistency(
+                plugin_id=plugin_id,
+                inconsistency_type=InconsistencyType.PLUGIN_MISSING_IN_CONFIG,
+                description=f"Plugin {plugin_id} exists on disk but not in config",
+                fix_action=FixAction.AUTO_FIX,
+                current_state={'exists_in_config': False},
+                expected_state={'exists_in_config': True, 'enabled': False},
+                can_auto_fix=True
+            ))
+        
+        # Check: Plugin in config but not on disk
+        if config.get('exists_in_config') and not disk.get('exists_on_disk'):
+            inconsistencies.append(Inconsistency(
+                plugin_id=plugin_id,
+                inconsistency_type=InconsistencyType.PLUGIN_MISSING_ON_DISK,
+                description=f"Plugin {plugin_id} in config but not on disk",
+                fix_action=FixAction.MANUAL_FIX_REQUIRED,
+                current_state={'exists_on_disk': False},
+                expected_state={'exists_on_disk': True},
+                can_auto_fix=False
+            ))
+        
+        # Check: Enabled state mismatch
+        config_enabled = config.get('enabled', False)
+        state_mgr_enabled = state_mgr.get('enabled')
+        
+        if state_mgr_enabled is not None and config_enabled != state_mgr_enabled:
+            inconsistencies.append(Inconsistency(
+                plugin_id=plugin_id,
+                inconsistency_type=InconsistencyType.PLUGIN_ENABLED_MISMATCH,
+                description=f"Plugin {plugin_id} enabled state mismatch: config={config_enabled}, state_manager={state_mgr_enabled}",
+                fix_action=FixAction.AUTO_FIX,
+                current_state={'enabled': config_enabled},
+                expected_state={'enabled': state_mgr_enabled},
+                can_auto_fix=True
+            ))
+        
+        return inconsistencies
+    
+    def _fix_inconsistency(self, inconsistency: Inconsistency) -> bool:
+        """Attempt to fix an inconsistency."""
+        try:
+            if inconsistency.inconsistency_type == InconsistencyType.PLUGIN_MISSING_IN_CONFIG:
+                # Add plugin to config with default disabled state
+                config = self.config_manager.load_config()
+                config[inconsistency.plugin_id] = {
+                    'enabled': False
+                }
+                self.config_manager.save_config(config)
+                self.logger.info(f"Fixed: Added {inconsistency.plugin_id} to config")
+                return True
+            
+            elif inconsistency.inconsistency_type == InconsistencyType.PLUGIN_ENABLED_MISMATCH:
+                # Sync enabled state from state manager to config
+                expected_enabled = inconsistency.expected_state.get('enabled')
+                config = self.config_manager.load_config()
+                if inconsistency.plugin_id not in config:
+                    config[inconsistency.plugin_id] = {}
+                config[inconsistency.plugin_id]['enabled'] = expected_enabled
+                self.config_manager.save_config(config)
+                self.logger.info(f"Fixed: Synced enabled state for {inconsistency.plugin_id}")
+                return True
+            
+        except Exception as e:
+            self.logger.error(f"Error fixing inconsistency: {e}", exc_info=True)
+            return False
+        
+        return False
+

src/plugin_system/testing/__init__.py

@@ -0,0 +1,17 @@
+"""
+Plugin Testing Framework
+
+Provides base classes and utilities for testing LEDMatrix plugins.
+"""
+
+from .plugin_test_base import PluginTestCase
+from .mocks import MockDisplayManager, MockCacheManager, MockConfigManager, MockPluginManager
+
+__all__ = [
+    'PluginTestCase',
+    'MockDisplayManager',
+    'MockCacheManager',
+    'MockConfigManager',
+    'MockPluginManager'
+]
+

src/plugin_system/testing/mocks.py

@@ -0,0 +1,181 @@
+"""
+Mock objects for plugin testing.
+
+Provides mock implementations of display_manager, cache_manager, config_manager,
+and plugin_manager for use in plugin unit tests.
+"""
+
+from typing import Dict, Any, Optional
+from unittest.mock import MagicMock
+from PIL import Image
+
+
+class MockDisplayManager:
+    """Mock display manager for testing."""
+    
+    def __init__(self, width: int = 128, height: int = 32):
+        self.width = width
+        self.display_width = width
+        self.height = height
+        self.display_height = height
+        self.image = Image.new('RGB', (width, height), color=(0, 0, 0))
+        self.clear_called = False
+        self.update_called = False
+        self.draw_calls = []
+    
+    def clear(self):
+        """Clear the display."""
+        self.clear_called = True
+        self.image = Image.new('RGB', (self.width, self.height), color=(0, 0, 0))
+    
+    def update_display(self):
+        """Update the display."""
+        self.update_called = True
+    
+    def draw_text(self, text: str, x: int, y: int, color: tuple = (255, 255, 255), font=None):
+        """Draw text on the display."""
+        self.draw_calls.append({
+            'type': 'text',
+            'text': text,
+            'x': x,
+            'y': y,
+            'color': color,
+            'font': font
+        })
+    
+    def draw_image(self, image: Image.Image, x: int, y: int):
+        """Draw an image on the display."""
+        self.draw_calls.append({
+            'type': 'image',
+            'image': image,
+            'x': x,
+            'y': y
+        })
+    
+    def reset(self):
+        """Reset mock state."""
+        self.clear_called = False
+        self.update_called = False
+        self.draw_calls = []
+        self.image = Image.new('RGB', (self.width, self.height), color=(0, 0, 0))
+
+
+class MockCacheManager:
+    """Mock cache manager for testing."""
+    
+    def __init__(self):
+        self._cache: Dict[str, Any] = {}
+        self._cache_timestamps: Dict[str, float] = {}
+        self.get_calls = []
+        self.set_calls = []
+        self.delete_calls = []
+    
+    def get(self, key: str, max_age: Optional[float] = None) -> Optional[Any]:
+        """Get a value from cache."""
+        import time
+        self.get_calls.append({'key': key, 'max_age': max_age})
+        
+        if key not in self._cache:
+            return None
+        
+        if max_age is not None:
+            timestamp = self._cache_timestamps.get(key, 0)
+            if time.time() - timestamp > max_age:
+                return None
+        
+        return self._cache.get(key)
+    
+    def set(self, key: str, value: Any, ttl: Optional[float] = None) -> None:
+        """Set a value in cache."""
+        import time
+        self.set_calls.append({'key': key, 'value': value, 'ttl': ttl})
+        self._cache[key] = value
+        self._cache_timestamps[key] = time.time()
+    
+    def delete(self, key: str) -> None:
+        """Delete a value from cache."""
+        self.delete_calls.append(key)
+        if key in self._cache:
+            del self._cache[key]
+        if key in self._cache_timestamps:
+            del self._cache_timestamps[key]
+    
+    def reset(self):
+        """Reset mock state."""
+        self._cache.clear()
+        self._cache_timestamps.clear()
+        self.get_calls = []
+        self.set_calls = []
+        self.delete_calls = []
+
+
+class MockConfigManager:
+    """Mock config manager for testing."""
+    
+    def __init__(self, config: Optional[Dict[str, Any]] = None):
+        self._config = config or {}
+        self.load_config_calls = []
+        self.save_config_calls = []
+    
+    def load_config(self) -> Dict[str, Any]:
+        """Load configuration."""
+        self.load_config_calls.append({})
+        return self._config.copy()
+    
+    def save_config(self, config: Dict[str, Any]) -> None:
+        """Save configuration."""
+        self.save_config_calls.append(config)
+        self._config = config.copy()
+    
+    def get_config(self, key: str, default: Any = None) -> Any:
+        """Get a config value."""
+        return self._config.get(key, default)
+    
+    def set_config(self, key: str, value: Any) -> None:
+        """Set a config value."""
+        self._config[key] = value
+    
+    def reset(self):
+        """Reset mock state."""
+        self._config = {}
+        self.load_config_calls = []
+        self.save_config_calls = []
+
+
+class MockPluginManager:
+    """Mock plugin manager for testing."""
+    
+    def __init__(self):
+        self.plugins: Dict[str, Any] = {}
+        self.plugin_manifests: Dict[str, Dict] = {}
+        self.get_plugin_calls = []
+        self.get_all_plugins_calls = []
+    
+    def get_plugin(self, plugin_id: str) -> Optional[Any]:
+        """Get a plugin instance."""
+        self.get_plugin_calls.append(plugin_id)
+        return self.plugins.get(plugin_id)
+    
+    def get_all_plugins(self) -> Dict[str, Any]:
+        """Get all plugin instances."""
+        self.get_all_plugins_calls.append({})
+        return self.plugins.copy()
+    
+    def get_plugin_info(self, plugin_id: str) -> Optional[Dict[str, Any]]:
+        """Get plugin information."""
+        manifest = self.plugin_manifests.get(plugin_id, {})
+        plugin = self.plugins.get(plugin_id)
+        if plugin:
+            manifest['loaded'] = True
+            manifest['runtime_info'] = getattr(plugin, 'get_info', lambda: {})()
+        else:
+            manifest['loaded'] = False
+        return manifest
+    
+    def reset(self):
+        """Reset mock state."""
+        self.plugins.clear()
+        self.plugin_manifests.clear()
+        self.get_plugin_calls = []
+        self.get_all_plugins_calls = []
+

src/plugin_system/testing/plugin_test_base.py

@@ -0,0 +1,153 @@
+"""
+Base test class for LEDMatrix plugins.
+
+Provides common fixtures and helper methods for plugin testing.
+"""
+
+import unittest
+import sys
+from pathlib import Path
+from typing import Dict, Any, Optional
+
+# Add project root to path for imports
+PROJECT_ROOT = Path(__file__).resolve().parent.parent.parent.parent
+if str(PROJECT_ROOT) not in sys.path:
+    sys.path.insert(0, str(PROJECT_ROOT))
+
+from src.plugin_system.testing.mocks import (
+    MockDisplayManager,
+    MockCacheManager,
+    MockConfigManager,
+    MockPluginManager
+)
+
+
+class PluginTestCase(unittest.TestCase):
+    """
+    Base test case for plugin testing.
+    
+    Provides common fixtures and helper methods.
+    """
+    
+    def setUp(self):
+        """Set up test fixtures."""
+        # Create mock managers
+        self.display_manager = MockDisplayManager(width=128, height=32)
+        self.cache_manager = MockCacheManager()
+        self.config_manager = MockConfigManager()
+        self.plugin_manager = MockPluginManager()
+        
+        # Default plugin configuration
+        self.plugin_config = {
+            'enabled': True,
+            'display_duration': 15.0
+        }
+        
+        # Plugin ID for tests
+        self.plugin_id = 'test-plugin'
+    
+    def tearDown(self):
+        """Clean up after tests."""
+        # Reset all mocks
+        self.display_manager.reset()
+        self.cache_manager.reset()
+        self.config_manager.reset()
+        self.plugin_manager.reset()
+    
+    def create_plugin_instance(self, plugin_class, plugin_id: Optional[str] = None, 
+                              config: Optional[Dict[str, Any]] = None):
+        """
+        Create a plugin instance with mock dependencies.
+        
+        Args:
+            plugin_class: Plugin class to instantiate
+            plugin_id: Optional plugin ID (defaults to self.plugin_id)
+            config: Optional config dict (defaults to self.plugin_config)
+        
+        Returns:
+            Plugin instance
+        """
+        pid = plugin_id or self.plugin_id
+        cfg = config or self.plugin_config.copy()
+        
+        return plugin_class(
+            plugin_id=pid,
+            config=cfg,
+            display_manager=self.display_manager,
+            cache_manager=self.cache_manager,
+            plugin_manager=self.plugin_manager
+        )
+    
+    def assert_plugin_initialized(self, plugin):
+        """Assert that plugin was initialized correctly."""
+        self.assertIsNotNone(plugin)
+        self.assertEqual(plugin.plugin_id, self.plugin_id)
+        self.assertEqual(plugin.config, self.plugin_config)
+        self.assertEqual(plugin.display_manager, self.display_manager)
+        self.assertEqual(plugin.cache_manager, self.cache_manager)
+        self.assertEqual(plugin.plugin_manager, self.plugin_manager)
+    
+    def assert_display_cleared(self):
+        """Assert that display was cleared."""
+        self.assertTrue(self.display_manager.clear_called)
+    
+    def assert_display_updated(self):
+        """Assert that display was updated."""
+        self.assertTrue(self.display_manager.update_called)
+    
+    def assert_text_drawn(self, text: Optional[str] = None):
+        """
+        Assert that text was drawn on display.
+        
+        Args:
+            text: Optional text to check for
+        """
+        text_calls = [c for c in self.display_manager.draw_calls if c['type'] == 'text']
+        self.assertGreater(len(text_calls), 0, "No text was drawn")
+        if text:
+            texts = [c['text'] for c in text_calls]
+            self.assertIn(text, texts, f"Text '{text}' not found in drawn texts: {texts}")
+    
+    def assert_image_drawn(self):
+        """Assert that an image was drawn on display."""
+        image_calls = [c for c in self.display_manager.draw_calls if c['type'] == 'image']
+        self.assertGreater(len(image_calls), 0, "No image was drawn")
+    
+    def assert_cache_get(self, key: Optional[str] = None):
+        """
+        Assert that cache.get was called.
+        
+        Args:
+            key: Optional key to check for
+        """
+        self.assertGreater(len(self.cache_manager.get_calls), 0, "cache.get was not called")
+        if key:
+            keys = [c['key'] for c in self.cache_manager.get_calls]
+            self.assertIn(key, keys, f"Key '{key}' not found in cache.get calls: {keys}")
+    
+    def assert_cache_set(self, key: Optional[str] = None):
+        """
+        Assert that cache.set was called.
+        
+        Args:
+            key: Optional key to check for
+        """
+        self.assertGreater(len(self.cache_manager.set_calls), 0, "cache.set was not called")
+        if key:
+            keys = [c['key'] for c in self.cache_manager.set_calls]
+            self.assertIn(key, keys, f"Key '{key}' not found in cache.set calls: {keys}")
+    
+    def get_mock_config(self, **overrides) -> Dict[str, Any]:
+        """
+        Get mock configuration with optional overrides.
+        
+        Args:
+            **overrides: Config values to override
+        
+        Returns:
+            Configuration dictionary
+        """
+        config = self.plugin_config.copy()
+        config.update(overrides)
+        return config
+