popiart-node-canvas

Commit Graph

Author	SHA1	Message	Date
jiajia	ca0b039a88	Restore reliable high-priority generation paths P0/P1 reports clustered around unavailable LLM defaults, video media connections, and missing controls on the generation surface. This routes the default NewApiWG LLM away from the unavailable Doubao channel, makes video a first-class schema and canvas connection type, carries request ids into node errors, and fills the composer, trim, audio, and 3D gaps without changing the canvas workflow model. Constraint: NewApiWG Doubao channels are not reliably routed in the default gateway Constraint: Video model schemas expose video fields that must not flow through image handles Rejected: Continue accepting video through image handles \| hides incorrect graph types and loses schema-specific dynamic inputs Confidence: high Scope-risk: moderate Directive: Keep media handle types explicit; add schema mapping when adding a new connectable media type Tested: npm run test:run -- src/store/execution/__tests__/generateVideoExecutor.test.ts src/store/utils/__tests__/connectedInputs.test.ts src/store/execution/__tests__/generateAudioExecutor.test.ts src/store/execution/__tests__/llmGenerateExecutor.test.ts src/store/__tests__/workflowStore.integration.test.ts src/lib/__tests__/llmModels.test.ts src/store/utils/__tests__/nodeDefaults.test.ts src/components/__tests__/GenerationComposer.test.tsx src/app/api/chat/__tests__/route.test.ts src/app/api/llm/__tests__/route.test.ts src/app/api/models/[modelId]/__tests__/route.test.ts src/app/api/generate/providers/__tests__/newapiwg.test.ts Tested: npm run build Tested: git diff --check Not-tested: npm run lint \| package script calls removed Next 16 next lint command Not-tested: npx tsc --noEmit \| existing test type errors remain; changed runtime files filtered clean	2 months ago
shrimbly	67c1affa22	feat: add audio-to-video capability type and model discovery Add "audio-to-video" to ModelCapability union, extend ModelInput.type and ModelInputDef.type with "audio", and include "audio-to-video" in fal.ai RELEVANT_CATEGORIES for model discovery. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	4 months ago
shrimbly	ccb5734683	Merge branch 'develop' into fix/fal-3d-url-extraction	5 months ago
Shrimbly	2c58afc352	feat: add TTS audio generation node support Add comprehensive text-to-speech (TTS) support with a new generateAudio node that integrates with multiple AI providers (Kie.ai, Replicate, fal.ai, WaveSpeed). Changes: - Add 'text-to-audio' capability to ModelCapability type - Add GenerateAudioNodeData type and CarouselAudioItem for audio history - Create GenerateAudioNode component with audio playback and waveform visualization - Add TTS models from Kie.ai (ElevenLabs Turbo v2.5, Multilingual v2, Eleven V3) - Update fal.ai category mapping to support 'text-to-speech' -> 'text-to-audio' - Add audio filter option to ModelSearchDialog - Register generateAudio node in WorkflowCanvas with fuchsia minimap color - Add generateAudio to ConnectionDropMenu for both audio source and text target - Update connectedInputs to handle audio output from generateAudio nodes - Add default node data and dimensions for generateAudio type - Update quickstart validation to include generateAudio node type The node supports: - Text-to-audio generation with multiple TTS models - Real-time audio playback with waveform visualization - Audio history carousel for navigating generated audio - Dynamic model parameters based on selected provider - Integration with existing audio handle system Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>	5 months ago
Willie	57d0cd860e	Release: 3D viewer, execute selected nodes, canvas navigation settings (#66 ) * refactor: extract schema utilities from generate route Extract INPUT_PATTERNS, InputMapping, ParameterTypeInfo, getParameterTypesFromSchema, coerceParameterTypes, and getInputMappingFromSchema into schemaUtils.ts with 23 new tests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract Gemini provider from generate route Move MODEL_MAP and generateWithGemini() into providers/gemini.ts. Remove unused imports (GoogleGenAI, uploadImageForUrl, shouldUseImageUrl, deleteImages, ProviderModel) from route.ts. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract Replicate provider from generate route Move generateWithReplicate() into providers/replicate.ts. It imports schema utilities from schemaUtils.ts. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract fal.ai, Kie.ai, WaveSpeed providers from generate route Move generateWithFalQueue, generateWithKie, generateWithWaveSpeed and all their helpers into providers/fal.ts, providers/kie.ts, providers/wavespeed.ts. Add barrel export at providers/index.ts. route.ts reduced from 2,838 to 518 lines (POST handler + routing only). Re-export clearFalInputMappingCache from route.ts for test backward compat. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract API header builder from workflow store Replace 6 duplicated header-building if/else chains (across executeWorkflow and regenerateNode) with buildGenerateHeaders() and buildLlmHeaders() utility functions. Add 13 new tests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract execution utilities from workflow store Move groupNodesByLevel, chunk, revokeBlobUrl, clearNodeImageRefs, and concurrency settings into executionUtils.ts with 21 new tests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract getConnectedInputs and validateWorkflow as pure functions Move getConnectedInputs (136 lines) and validateWorkflow (59 lines) into connectedInputs.ts as pure functions taking (nodeId, nodes, edges). Store methods become thin wrappers. Add 22 new tests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: define node executor interface and context types Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract simple node executors Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: unify nanoBanana execution into shared executor Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: unify generateVideo execution into shared executor Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: unify llmGenerate execution into shared executor Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: unify splitGrid execution into shared executor Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: unify videoStitch and easeCurve executors Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: replace switch/if-else with node executor registry Wire extracted executors into workflowStore, replacing the ~1000-line switch statement in executeWorkflow and ~750-line if-else chain in regenerateNode with executor registry calls. Store reduced from 3,402 to 1,782 lines. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: final cleanup of workflowStore module structure Remove dead trackSaveGeneration function (no longer called after executor extraction) and unused type imports. Store: 3,838 -> 1,721 lines (55% reduction). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: video regeneration spinner stuck + cancel error message Fix video element not reloading on regeneration by adding key prop tied to video history ID. Fix cancel showing timeout message by passing "user-cancelled" reason through AbortController and checking it in all three executor catch blocks. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: address PR #59 review — 18 bug, security, and robustness fixes Providers: - fal: don't cache failed schema fetches, remove duplicate param spread, SSRF-validate mediaUrl - gemini: remove redundant header overrides, fix nano-banana model ID - kie: module-level MAX_MEDIA_SIZE, post-download size check, upload size guard - replicate: remove duplicate param spread, validate modelId format - wavespeed: post-download size check, NaN-safe parseInt, prevent prompt overwrite Executors: - generateVideo: validate stored fallback inputs same as regular path - nanoBanana: cap imageHistory at 50 entries - splitGrid: handle img.onerror with warning + null data - videoProcessing: add FileReader onerror/onabort handlers Utilities: - connectedInputs: use ?? instead of \|\| for outputText/template - executionUtils: guard orphan children in topological sort, validate chunk() size Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: additional PR review fixes — SSRF, data semantics, sync tracking, error propagation Providers: - replicate: add SSRF validation on mediaUrl before fetch - fal/kie/replicate/wavespeed: large-video returns data="" with url set instead of putting raw URL in data field (violates GenerationOutput.data semantic) - kie: remove stale WaveSpeed JSDoc block from kie provider file - route.ts: update all output handling to support data="" + url for large videos Executors: - generateVideoExecutor/nanoBananaExecutor: track save-generation fetch in pendingImageSyncs via new trackSaveGeneration context method so auto-save waits for server ID resolution - videoProcessingExecutors: throw errors instead of returning in validation branches (encoderSupported, insufficient videos, no video connected) so Promise.allSettled sees rejections - types.ts: add trackSaveGeneration to NodeExecutionContext interface - workflowStore: wire trackSaveGeneration into both execution context sites Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: content-type fallback, replicate polling/validation, atomic gallery append - fal.ts: Use model capabilities to determine fallback content-type (video/mp4 vs image/png) instead of defaulting to video for all models - replicate.ts: Increase polling timeout to 10 min for video models; filter output array to valid strings before URL validation - nanoBananaExecutor.ts: Replace read-modify-write on outputGallery with atomic appendOutputGalleryImage using Zustand set() callback Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract _buildExecutionContext to deduplicate NodeExecutionContext construction Replace identical inline context creation in executeWorkflow and regenerateNode with a single shared helper, ensuring consistent behavior across both code paths. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add keyboard shortcuts help dialog - New KeyboardShortcutsDialog component showing all available shortcuts - Accessible via ? button in header and ? key on canvas - Groups shortcuts by category: General, Add Nodes, Layout, Canvas - Auto-detects Mac vs Windows/Linux for modifier key display - Follows existing modal patterns (Escape to close, backdrop click) * feat: add keyboard shortcuts dialog and 3D GLB viewer node - Keyboard shortcuts: press ? or click keyboard icon to view all shortcuts - 3D GLB viewer: upload .GLB files, orbit/rotate, capture as image output - Fix: restore trailing newline in gemini.ts provider * fix: make Prompt node editable when connected to LLM node When a Prompt node receives text from an LLM Generate node, the text should be editable by the user. Previously, the textarea was marked as readOnly when there was an incoming text connection, preventing edits in both the main view and the expanded modal. Changes: - Track last received LLM output to detect when it changes - Only update prompt when LLM node runs again (output changes) - Allow user edits in between LLM runs - Remove readOnly restriction on textarea - Update placeholder text to indicate editability This allows users to edit the LLM-generated text, which will be replaced only when the LLM node runs again, not on every render. Fixes #1470061054246518927 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * fix: PR review fixes — lazy-load three.js, blob URL cleanup, missing integrations - Remove unused `useLoader` import from GLBViewerNode - Add useEffect cleanup to revoke blob URL on node unmount (memory leak) - Replace alert() with useToast for file validation errors - Lazy-load GLBViewerNode via next/dynamic to avoid bundling three.js for all users - Add glbViewer to ConnectionDropMenu IMAGE_SOURCE_OPTIONS - Add glbViewer case to quickstart validation createDefaultNodeData (build fix) - Restore trailing newline in gemini.ts Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: address PR #64 review — blob leak, error handling, tests, docs Move @types/three to devDependencies, fix blob URL cleanup to track changes (not just unmount), add try/catch to capture and scene disposal, remove GLBViewerNode from barrel export to preserve lazy-loading, fix JSDoc, update CLAUDE.md with glbViewer node and ? shortcut, add connectedInputs and nodeDefaults tests for glbViewer. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: improve GLB viewer — fix viewport sizing, add spot light, handle labels, scroll isolation - Fix 3D viewport not filling node by adding resize={{ offsetSize: true }} for correct measurement in CSS-transformed React Flow nodes - Replace grid/axis indicators with spot light for cleaner scene - Add labeled input (3D) and output (Image) handles matching generate node style - Add native wheel event listener to prevent graph zoom/pan while scrolling to zoom 3D model - Remove redundant CSS workarounds (absolute positioning style, extra relative wrapper) - Add edge-to-edge viewport via contentClassName (removes default padding when GLB loaded) - Overlay controls bar on viewport with gradient background Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add customizable canvas navigation settings (#65) * feat: add customizable canvas navigation settings Add a new settings modal that allows users to configure canvas navigation preferences: - Pan Mode: Space + Drag (default), Middle Mouse, or Always On (ComfyUI-style) - Zoom Mode: Alt + Scroll (default), Ctrl + Scroll, or Scroll (no modifier) - Selection Mode: Click (default) or Alt + Drag Features: - Settings persist in localStorage - New canvas settings button in header (monitor icon) - Modal UI with radio button groups for each setting - React Flow props dynamically configured based on user preferences - Updated wheel event handler to respect zoom mode settings This addresses user requests for ComfyUI/TouchDesigner-style navigation where panning and zooming work without holding modifier keys. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * fix: PR #65 review — altDrag selection bug, icon, dedup, tests - Fix altDrag selection mode: use selectionKeyCode="Alt" instead of selectionOnDrag=true which made drag-select work without any key - Replace misleading video camera icon with arrows-pointing-out for canvas navigation settings button - Extract duplicated settings buttons JSX into settingsButtons variable shared by both configured/unconfigured project branches - Add defensive useEffect to sync CanvasSettingsModal state on open - Add missing semicolon in types/index.ts canvas re-export - Add localStorage tests for getCanvasNavigationSettings and saveCanvasNavigationSettings - Add integration tests for updateCanvasNavigationSettings - Fix WorkflowCanvas test mocks to include canvasNavigationSettings Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: move canvas navigation settings into Project Settings modal Consolidate canvas settings from standalone CanvasSettingsModal into a new "Canvas" tab in ProjectSetupModal. Remove "like ComfyUI" text, add Shift+Drag selection mode, and fix save button to bottom of dialog. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: remove double semicolon in types/index.ts Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> --------- Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com> * feat: add executeSelectedNodes with topo sort, abort, and downstream propagation Implements the "Run selected nodes" feature (PR #61) with fixes for all 8 review issues: topological ordering via groupNodesByLevel, AbortController cancellation, glbViewer case coverage, AbortError filtering, downstream consumer propagation with dedup guard, and dynamic button label. Also extracts saveLogSession helper to replace 4 inline duplicates across executeWorkflow and regenerateNode. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: 3D model saving, error handling, and node improvements - Save 3D models (GLB) to generations folder via save-generation API - Add try-catch to WaveSpeed polling loop to handle network errors - Skip downloading 3D model bodies in WaveSpeed (return URL directly) - Fix schemaUtils false-positive matching for short property names - Stabilize GenerateImageNode output handle ID (always "image") - Fix GLBViewerNode: block-body forEach lint, store-based resize - Use useRef instead of useState for PromptNode lastReceivedText - Add executeGlbViewer tests and abort signal support - Fix annotation stale pass-through when upstream image changes - Skip error status on AbortError in all executor catch blocks - Revoke glbUrl blob URLs in clearNodeImageRefs Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * docs: require per-task commits in multi-task plans Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add Generate3DNodeData type definitions Add "generate3d" to NodeType union, Generate3DNodeData interface, Generate3DNodeDefaults, and update NodeDefaultsConfig. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add generate3d node defaults and dimensions Add default dimensions (300x300) and createDefaultNodeData case for the generate3d node type. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: create generate3d executor Extracted from nanoBananaExecutor's 3D handling code. Handles 3D model generation via /api/generate with mediaType: "3d", cost tracking, and auto-save to generations folder. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: create Generate3DNode component Dedicated node component for 3D model generation, modeled after GenerateVideoNode. Features: dynamic input handles from schema, 3D output handle, model browsing, parameter controls, status overlays. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: register generate3d node type across codebase Register in execution index, workflowStore (executeWorkflow, regenerateNode, executeSelectedNodes), nodes index, WorkflowCanvas (nodeTypes, getNodeHandles, minimap color, findCompatibleHandle). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add generate3d source output in connectedInputs Add generate3d case in getSourceOutput() to return 3D URL data, enabling downstream nodes to receive 3D model output. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: route 3D models to generate3d in ModelSearchDialog Add "3d" capability filter, update handleSelectModel to detect 3D models and create generate3d nodes with capabilities passed through, update recent models filter for 3D. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: update ConnectionDropMenu 3D source to use generate3d Change THREE_D_SOURCE_OPTIONS from nanoBanana to generate3d with cube icon and "Generate 3D" label. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: remove 3D code from GenerateImageNode and nanoBananaExecutor - Remove text-to-3d/image-to-3d from IMAGE_CAPABILITIES - Remove is3D memo and conditional handle/label styling - Remove 3D output preview block - Remove output3dUrl from model change handlers - Remove is3DModel detection and mediaType from nanoBanana executor - Remove 3D response handling from nanoBanana executor - Remove output3dUrl from NanoBananaNodeData and its defaults - Remove 3D fallback from nanoBanana in connectedInputs Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: update tests and remaining registrations for generate3d - Add Generate3DNode.test.tsx with render, handle, and output tests - Add 3D handle tests to ConnectionDropMenu.test.tsx - Add 3D model routing test to ModelSearchDialog.test.tsx - Update ModelSearchDialog test expectations for capabilities passthrough - Register generate3d in executeNode.ts dispatcher - Add generate3d to WorkflowCanvas keyboard shortcut dimensions - Add generate3d to quickstart validation (VALID_NODE_TYPES, dimensions, defaults) - Add generate3d to chat tools (VALID_NODE_TYPES, description) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: unwrap array inputs for non-array API parameters When multiple images are connected to a generation node, dynamicInputs aggregates them into arrays. Providers wrapped single values into arrays for array-typed params, but never unwrapped arrays for string-typed params, causing API failures (e.g. fal's image_url receiving an array instead of a string). Add symmetric unwrap logic across all four providers. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: move 3D from floating action bar to Generate submenu Replace top-level glbViewer button with generate3d option in the Generate combo dropdown, between Video and Text (LLM). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: hide CostIndicator when non-Gemini providers are in workflow The pricing calculator only has reliable data for Gemini models. When non-Gemini providers (fal, replicate, kie, wavespeed) are used, the displayed cost is incomplete/misleading. Add hasNonGeminiProviders() utility and use it to hide the CostIndicator entirely in that case. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add 3D capability badges to ModelSearchDialog Add text-to-3d and image-to-3d capability badge styling. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add play/run icon to LLM Generate node title bar Wire onRun and isExecuting props to BaseNode, matching the pattern used in GenerateImageNode and GenerateVideoNode. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: clear imageRef when user provides new image to prevent stale saves When a user pastes/uploads a new image into a node that already has a saved imageRef, the externalization logic incorrectly assumes the base64 is just hydrated data and discards it. Clear Ref fields whenever new image data is set so the save logic correctly persists the new image. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> fix: guard against undefined from empty array unwrap in fal provider Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: add 3x2 grid layout option to split grid node Change layout selector from count-based to layout-based, allowing both 2x3 and 3x2 (portrait) layouts that produce 6 images. Now shows 7 layout options (2x2, 1x5, 2x3, 3x2, 2x4, 3x3, 2x5) with RxC labels. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> Co-authored-by: charlieshoelace <charlieshoelace@gmail.com>	5 months ago
shrimbly	3ebaae82de	feat: improve GLB viewer — fix viewport sizing, add spot light, handle labels, scroll isolation - Fix 3D viewport not filling node by adding resize={{ offsetSize: true }} for correct measurement in CSS-transformed React Flow nodes - Replace grid/axis indicators with spot light for cleaner scene - Add labeled input (3D) and output (Image) handles matching generate node style - Add native wheel event listener to prevent graph zoom/pan while scrolling to zoom 3D model - Remove redundant CSS workarounds (absolute positioning style, extra relative wrapper) - Add edge-to-edge viewport via contentClassName (removes default padding when GLB loaded) - Overlay controls bar on viewport with gradient background Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	5 months ago
shrimbly	37eaff8459	fix: parallel execution state corruption, WaveSpeed SSRF, and blob URL leaks - Refactor executeSingleNode error paths to throw instead of setting global isRunning/currentNodeIds state, which corrupted sibling nodes running in parallel via Promise.allSettled - Validate WaveSpeed providedPollUrl with SSRF check before use - Sanitize WaveSpeed taskId in provider with path-traversal validation - Revoke blob URLs (URL.revokeObjectURL) before replacing outputVideo to prevent memory leaks from large video files - Move pause edge cleanup to outer executeWorkflow loop Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	eda8100bec	feat: add SSRF protection, URL encoding, modelId validation, and media size limits - Add validateMediaUrl() utility to block private IPs, localhost, and non-HTTP protocols before server-side fetches (with tests) - URL-encode Kie taskId in poll URL to prevent injection - Validate WaveSpeed modelId against path traversal in both route.ts and wavespeed.ts provider - Add 500MB Content-Length check before downloading media at all 3 fetch sites (Kie, WaveSpeed route, WaveSpeed provider) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	9806f0ae0a	feat: add all missing Kie.ai models + fix model page links Add ~38 new image/video models (Imagen 4, FLUX.2, Flux Kontext, Grok Imagine, Ideogram, Qwen, Runway, Hailuo, Seedance variants, Kling older, Wan older) with schemas and endpoint routing for dedicated APIs (Flux Kontext, Runway). Add pageUrl to all Kie models and update ModelSearchDialog to use it. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
Franco Aparicio	f0710bf830	Add WaveSpeed provider integration	6 months ago
shrimbly	f2571e96db	fix(quick-001): fix type signatures and store aggregation for multi-image dynamicInputs - Update dynamicInputs type from Record<string, string> to Record<string, string \| string[]> in 4 locations - Fix getConnectedInputs to aggregate same-key values into arrays instead of overwriting - Fix dynamicInputs.prompt access to handle array case - Fix hasPrompt check in POST handler to handle array-typed prompt - Update processedDynamicInputs type in both Replicate and fal blocks Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	dc2966a9ad	fix(quick-001): fix type signatures and store aggregation for multi-image dynamicInputs - Update dynamicInputs type from Record<string, string> to Record<string, string \| string[]> in 4 locations - Fix getConnectedInputs to aggregate same-key values into arrays instead of overwriting - Fix dynamicInputs.prompt access to handle array case - Fix hasPrompt check in POST handler to handle array-typed prompt - Update processedDynamicInputs type in both Replicate and fal blocks Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	0706bc0888	fix: wrap dynamicInputs in arrays when schema expects array type When providers like fal.ai or Replicate expect array parameters (e.g., image_urls), single values from dynamicInputs are now automatically wrapped in arrays based on the OpenAPI schema's type property. Changes: - Add isArray field to ModelInput type for schema detection - Update getFalInputMapping() to return schemaArrayParams - Update getInputMappingFromSchema() to return schemaArrayParams - Apply array wrapping in both fal.ai and Replicate handlers - Add tests for array wrapping behavior Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	55a905b926	feat(12-01): extend model cache TTL to 1 hour - Changed DEFAULT_TTL from 10 minutes to 60 minutes - Reduces API calls to provider model listing endpoints - Models don't change frequently, longer TTL is appropriate	6 months ago
shrimbly	dd2549f820	feat(ENHANCE-001): complete dynamic handles and execution pipeline - Render dynamic input handles from model schema (GenerateImage/VideoNode) - Update connection validation with getHandleType() helper - Add dynamicInputs to getConnectedInputs() return value - Pass dynamicInputs through generation pipeline (workflowStore -> API) - Update generateWithFal/Replicate to use dynamic inputs - Process large images in dynamicInputs to URLs for external providers - Support prompt from dynamicInputs when top-level prompt is empty Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	df505380c1	feat(ENHANCE-001): extract model inputs from schema - Add ModelInput type for connectable inputs (image/text handles) - Update model schema API to return both parameters and inputs - Categorize properties: image inputs, text inputs, and parameters - Sort inputs by required status and type Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	beb0af3089	feat(06-03): add model schema endpoint and ModelParameter type - Create /api/models/[modelId] endpoint for fetching model parameter schemas - Add ModelParameter interface to lib/providers/types.ts - Support both Replicate and fal.ai providers - Filter out internal params, prioritize user-relevant ones - 10-minute cache TTL for schema responses	6 months ago
shrimbly	d9c0ce75cb	feat(03-02): implement fal.ai provider generate() method Implement generation via fal.ai's fal.run API: - POST to https://fal.run/{modelId} with prompt and parameters - Use "Key {apiKey}" auth header (works without key but rate limited) - Extract image URL from response (handles images array, image object, or output string) - Fetch image and convert to base64 data URL - Return GenerationOutput with type: "image" Note: Image inputs skipped for now (Phase 5 adds URL server) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	cbfdc9f579	feat(03-02): implement Replicate provider generate() method Implement generation via Replicate's prediction API: - POST to /predictions with model version and prompt - Poll /predictions/{id} until succeeded/failed/canceled - Fetch output image URL and convert to base64 data URL - Return GenerationOutput with type: "image" Note: Image inputs skipped for now (Phase 5 adds URL server) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	91a54496ad	feat(02-03): add provider module exports and helper functions Export cache utilities from provider index and add listAllModels/ searchAllModels helper functions for multi-provider operations. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	83ef0b4dc4	feat(02-03): create model caching utility Add in-memory cache for provider model lists with 10-minute TTL. Includes get/set/invalidate functions and cache key generation. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	be490bbcd7	fix(02-01): add null check for search results to prevent crash Add defensive null checks before calling .map() on data.results in both the API route and provider implementation. Returns empty array with success:true when results is undefined, preventing "Cannot read properties of undefined (reading 'map')" crash. Fixes: UAT-001 from 02-01-ISSUES.md Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	2fe312db43	fix(02-02): remove multiple category params causing 400 error fal.ai API only accepts a single category parameter, but we were sending multiple categories. Now we fetch all active models and filter client-side using the existing isRelevantModel() function. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	523bc1f5e6	feat(02-02): create fal.ai provider implementation Implement ProviderInterface for fal.ai model marketplace: - Model discovery via REST API (listModels, searchModels, getModel) - Filter to relevant categories (text-to-image, image-to-image, text-to-video, image-to-video) - Optional API key auth (works without key but with rate limits) - Self-registration in provider registry on import - Stub generate() for Phase 3 implementation Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	ac10daf22d	feat(02-01): create Replicate provider implementation - Implement ProviderInterface for Replicate.com - listModels() fetches from /v1/models endpoint - searchModels() uses /v1/search endpoint - getModel() retrieves single model by owner/name - inferCapabilities() from model name/description - Self-registers via registerProvider() on import - API key read from localStorage provider settings Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	c8618ab58a	feat(01-02): create provider registry and factory Add provider registry in src/lib/providers/index.ts: - Export all types from types.ts - providerRegistry for storing provider implementations - registerProvider() for providers to self-register - getProvider() to retrieve provider by type - getConfiguredProviders() to get providers with API keys - getAllProviders() to get all registered providers Registry will be populated when provider modules are imported in Phase 2 (Replicate and fal.ai implementations). Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago
shrimbly	8b49db4a6f	feat(01-02): create provider abstraction interfaces Add provider abstraction layer in src/lib/providers/types.ts: - ProviderModel interface for normalized model metadata - ModelCapability union type for model capabilities - GenerationInput/GenerationOutput interfaces for unified I/O - ProviderInterface contract for provider implementations This establishes the interface contract that all providers (Gemini, Replicate, fal.ai) will implement in Phase 2. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	6 months ago

24 Commits (feature_apikey)