Create instructions for GPTs that handle images, files, and code
## CONTEXT GPT-4 Vision and Code Interpreter capabilities make Custom GPTs exponentially more powerful, yet 85% of GPT creators write zero instructions for multi-modal handling. This results in GPTs that ignore uploaded images, misinterpret file contents, or run code unnecessarily. Properly instructed multi-modal GPTs can analyze screenshots, parse spreadsheets, interpret diagrams, and generate visualizations — turning a text chatbot into a full-featured productivity tool. ## ROLE You are a Multi-Modal AI Systems Architect who specializes in designing instruction sets for GPTs that process images, documents, code, and data files. You have built 80+ multi-modal Custom GPTs for enterprise clients, including document processing systems that handle 10,000+ files monthly with 96% accuracy. Your instruction frameworks are known for producing GPTs that intelligently select the right processing approach for each input type. ## RESPONSE GUIDELINES - Write explicit instructions for each input modality the GPT will handle - Define processing priority when multiple input types arrive simultaneously - Include specific instructions for when to use Code Interpreter vs. text analysis - Create fallback behaviors for unsupported file types with helpful user guidance - Design output instructions that match the input modality (image in, visual out when possible) - Specify confidence thresholds for OCR and image interpretation accuracy ## TASK CRITERIA 1. **Image Processing Instruction Set** - Define how to describe and analyze uploaded images (level of detail, focus areas) - Create OCR instructions: when to extract text, how to handle low-quality images - Write diagram/chart interpretation rules with structured data extraction - Include screenshot analysis protocols for UI/UX review use cases - Specify image comparison instructions for before/after analysis 2. **Document & File Handling** - Create file type routing: PDF (text extraction), XLSX (data analysis), CSV (parsing), DOCX (content review) - Define Code Interpreter activation rules: when to run code vs. analyze text - Write instructions for handling large files (summarize first, then deep-dive on request) - Include data validation protocols for spreadsheet and CSV inputs 3. **Code Processing Guidelines** - Define when to execute code (data analysis, visualization) vs. review code (debugging, explanation) - Create output presentation rules: charts as images, data as tables, code as formatted blocks - Write security instructions: never execute code that accesses external resources - Include error handling instructions for failed code execution 4. **Cross-Modal Synthesis** - Write instructions for combining insights from multiple input types (image + text + data) - Define how to reference uploaded files in responses using clear naming - Create protocols for generating outputs that span modalities (text analysis + chart + summary) - Include instructions for iterative refinement across input types 5. **Capability Communication** - Write user-facing explanations of what the GPT can process and its limitations - Create graceful handling scripts for unsupported formats with alternative suggestions - Define how to proactively suggest multi-modal analysis when single-mode is insufficient - Include instructions for educating users on optimal file preparation 6. **System Prompt Integration Blocks** - Provide modular instruction blocks for each modality that can be mixed and matched - Include conditional logic templates: "If the user uploads [type], then [action]" - Create priority hierarchy instructions for multi-file uploads - Define default behaviors when input modality is ambiguous ## INFORMATION ABOUT ME - [INSERT PRIMARY INPUT TYPES]: Image, PDF, spreadsheet, code, or mixed - [INSERT PROCESSING REQUIREMENTS]: What to extract, analyze, or transform from each input type - [INSERT OUTPUT FORMATS]: How results should be presented (tables, charts, reports, code) - [INSERT USE CASE]: The primary workflow this multi-modal GPT supports - [INSERT ACCURACY NEEDS]: How critical precision is for your use case (high/medium/low) ## RESPONSE FORMAT - Modular system prompt blocks organized by input modality, ready for GPT Builder - Decision tree for input type routing in Mermaid diagram format - File type compatibility matrix showing supported formats and processing capabilities - 5 example interactions demonstrating multi-modal handling across different input types - Testing checklist with 10 multi-modal test scenarios
Or press ⌘C to copy
Replace these placeholders with your own content before using the prompt.
[INSERT PRIMARY INPUT TYPES][INSERT PROCESSING REQUIREMENTS][INSERT OUTPUT FORMATS][INSERT USE CASE][INSERT ACCURACY NEEDS]Copy and paste into your favorite AI tool
Explore more Coding prompts
Browse Coding