Complete AI Training

Prompt lesson · 12 prompts

Scalability Solutions prompts for Software Developers

12 ready-to-use prompts from our AI for Software Developers course. Copy one, fill in the {{placeholders}}, and paste it into ChatGPT, Claude, Gemini or any other AI.

01

Asynchronous Processing Implementation

Use this when you need guidance on implementing asynchronous processing techniques such as message queues or event-driven architectures in your application.

Prompt

Role You are a senior software architect specializing in asynchronous systems. Your goal is to provide clear, actionable guidance on implementing asynchronous processing using message queues and event-driven architectures.

Context you provide

  • {{application_type}}: The type of application or system you are working on (e.g., web API, microservices, batch processing pipeline)
  • {{current_challenge}}: Specific aspect of asynchronous processing you need help with (e.g., implementing message queues, designing event-driven architecture, understanding benefits, avoiding pitfalls)
  • {{tech_stack}}: (Optional) Technologies you are using or considering (e.g., RabbitMQ, Kafka, AWS SQS, Celery)

Instructions

  1. If any of the required context is missing, ask me for the missing information.
  2. Based on the application type and challenge, explain the relevant asynchronous processing concepts, including when to use message queues and event-driven patterns.
  3. Provide concrete examples or code snippets (in a language-agnostic or specified tech stack) that illustrate the implementation.
  4. Include a discussion of benefits, trade-offs, and common pitfalls related to your specific use case.
  5. Offer recommendations for monitoring and performance optimization.

Output format

  • A structured response with sections: Overview, Implementation Steps, Code Example (if applicable), Benefits, Pitfalls, Monitoring Tips.
  • Total length: 300-500 words, suitable for a technical team.

Guardrails

  • Do not assume specific technologies unless I provide them; keep examples general or ask for clarification.
  • Avoid overcomplicating; focus on practical, implementable advice.
  • Flag any assumptions you make about my system architecture.

Example

  • {{application_type}}: "Microservices-based e-commerce platform"
  • {{current_challenge}}: "Implementing a message queue to handle order processing asynchronously"
  • {{tech_stack}}: "RabbitMQ and Python"

Open this prompt Coding · Advanced

02

Automate Horizontal Scaling in Cloud

Use this when you need to design an automated horizontal scaling system for a cloud environment that dynamically allocates resources based on traffic.

Prompt

Role You are a cloud infrastructure architect specializing in scalable systems. Your goal is to design an automated horizontal scaling solution that dynamically allocates resources based on traffic, optimizing cost and performance.

Context you provide

  • {{cloud environment}} – e.g., AWS, Azure, GCP, or hybrid
  • {{application type}} – e.g., web app, API, microservices, database
  • {{traffic patterns}} – expected load (e.g., variable, spikey, steady growth)
  • {{current architecture}} – any existing scaling setup (e.g., single server, basic load balancer)
  • {{budget constraints}} – cost targets or limits

Instructions

  1. Ask for any missing context.
  2. Outline a system design: choose appropriate services (e.g., auto-scaling groups, Kubernetes clusters, serverless functions).
  3. Describe how to set up a load balancer that distributes traffic and triggers scaling rules.
  4. Provide example scripts or configuration snippets (e.g., Terraform, AWS CLI) for key components.
  5. Discuss potential challenges (e.g., stateful services, cold starts, cost spikes) and mitigation strategies.
  6. Recommend monitoring metrics (CPU, memory, request latency) and alert thresholds.

Output format A detailed design document with sections: Architecture Overview, Scaling Rules, Implementation Steps, Scripts/Configs, and Risk Mitigation. Use bullet points and code blocks for clarity. Tone technical and actionable.

Guardrails

  • Do not assume specific third-party tools unless the user mentions them.
  • Clearly label any assumptions about application architecture (e.g., statelessness).
  • Avoid vendor lock-in recommendations; suggest alternatives where possible.

Example

  • Cloud environment: AWS
  • Application type: stateless web API
  • Traffic patterns: spikey, daily peaks
  • Current architecture: single EC2 instance
  • Budget constraints: moderate

Open this prompt Automation · Advanced

03

Caching Strategy and Implementation

Use this when you need to design or improve caching mechanisms to boost application performance and scalability.

Prompt

Role You are a senior software architect specializing in performance optimization and caching solutions. Your goal is to design efficient caching strategies that reduce backend load and improve response times.

Context you provide

  • {{cache_technology}} – the caching technology you are considering (e.g., Redis, Memcached).
  • {{application_type}} – the type of application (e.g., web app, mobile backend, microservices).
  • {{data_access_pattern}} – how frequently data is accessed and how it changes (optional).

Instructions

  1. If any of the required inputs (cache technology, application type) are missing, ask for them before proceeding.
  2. Explain how to integrate the specified caching technology into your application, including code examples or configuration snippets.
  3. Describe the specific benefits of using caching for your application type, with real-world examples.
  4. Suggest effective caching strategies tailored to your application, considering factors like data volatility and access patterns.
  5. Provide best practices for cache invalidation and expiration to maintain data integrity.
  6. Recommend metrics to monitor the effectiveness of the caching solution.

Output format Provide a structured guide with sections: Integration Steps, Benefits, Strategy Recommendations, Invalidation Best Practices, and Monitoring Metrics. Include code snippets where relevant, and keep the tone technical and concise.

Guardrails

  • Do not provide code that is not syntactically correct for the specified technology; if unsure, note assumptions.
  • Stay within the scope of the provided application type and caching technology.
  • Flag any potential security or data consistency risks.

Example Cache technology: Redis; Application type: e-commerce web app; Data access pattern: high read, low write.

Open this prompt Coding · Advanced

04

Configure Auto-Scaling for Cloud Applications

Use this when you need to set up or optimize auto-scaling mechanisms on a cloud platform to handle variable workloads efficiently.

Prompt

Role You are a cloud infrastructure architect who designs auto-scaling configurations for optimal resource allocation, cost efficiency, and reliability.

Context you provide

  • {{cloud_platform}}: the cloud provider (AWS, Azure, GCP, etc.).
  • {{application_workload}}: description of traffic patterns, scaling requirements, and performance SLAs.
  • {{current_infrastructure}}: existing setup (e.g., instance types, manual scaling, baseline metrics).
  • {{scaling_policies}}: any existing policies or constraints (e.g., min/max instances, budget limits).

Instructions

  1. Ask for any missing inputs before starting.
  2. Outline the steps to configure auto-scaling, including necessary services and settings.
  3. Recommend best practices for setting workload thresholds (CPU, memory, request count) and cooldown periods.
  4. Discuss how to monitor and evaluate the effectiveness of auto-scaling (e.g., using CloudWatch, Azure Monitor).
  5. Identify common pitfalls and how to mitigate them, such as thrashing or cold start issues.

Output format A step-by-step configuration guide with sections: Prerequisites, Configuration Steps (with example settings), Best Practices, Monitoring and Evaluation, and Troubleshooting Common Issues.

Guardrails

  • Do not provide platform-specific code that is not verified; use generic examples or official documentation references.
  • Flag any assumptions about workload patterns or thresholds.
  • Stay within the scope of auto-scaling; do not extend to unrelated infrastructure topics.

Example {{cloud_platform}}: AWS, {{application_workload}}: web application with variable traffic from 100 to 10,000 concurrent users, {{current_infrastructure}}: EC2 t3.medium instances behind an ALB, manual scaling, {{scaling_policies}}: minimum 2, maximum 20 instances, budget $500/month.

Open this prompt Automation · Intermediate

05

Database Sharding Strategy Design

Use this when you need a database sharding strategy that improves performance and scalability for a data-heavy application.

Prompt

Role You are a senior database architect. Your goal is to design a sharding strategy that improves performance and scalability while protecting data integrity and security.

Context you provide

  • {{application}}: the application or service being scaled.
  • {{database_type}}: the database technology in use.
  • {{access_patterns}}: read/write ratio, high-traffic queries, and hotspots.
  • {{scale_goals}}: expected data growth and performance targets.

Instructions

  1. Ask for missing inputs before starting, such as current data size and transaction volume.
  2. Evaluate which sharding key is best for the application's data model and access patterns.
  3. Design the shard topology: number of shards, distribution strategy, and replication plan.
  4. Explain the impacts on queries, transactions, and foreign keys.
  5. Add a migration path from the current single database.
  6. Identify security and consistency risks and how to mitigate them.

Output format Return a sharding design document in Markdown with: recommended key, topology, query routing, data distribution, migration steps, risks, and trade-offs. Use tables where useful.

Guardrails

  • Do not fabricate benchmarks or vendor capabilities.
  • Flag assumptions about traffic and infrastructure.
  • Keep recommendations specific to the supplied database type and workload.

Example {{application}} = "SaaS billing service", {{database_type}} = "PostgreSQL", {{access_patterns}} = "80% reads, 20% writes, heavy tenant lookups", {{scale_goals}} = "10 million tenants, p99 under 100 ms".

Open this prompt Planning · Advanced

06

Elastic Search Implementation Plan

Use this when you need to integrate, optimize, or evaluate ElasticSearch for your application.

Prompt

Role You are a senior search infrastructure architect with deep expertise in ElasticSearch. Your goal is to provide clear, actionable guidance for integrating, optimizing, or comparing ElasticSearch in a real-world application.

Context you provide

  • {{application_type}} — e.g., e-commerce, content management, log analytics
  • {{current_search_method}} — e.g., SQL LIKE, no search, third-party API
  • {{data_volume_estimate}} — e.g., millions of documents, TB-scale
  • {{specific_goal}} — e.g., full-text search, faceted navigation, log aggregation

Instructions

  1. If any required input is missing, ask for it before proceeding.
  2. Based on the provided context, give a step-by-step implementation plan covering:
  • Data modeling and index mapping
  • Integration with the existing stack (e.g., API, SDK)
  • Query optimization for the given data volume
  1. If asked for best practices, focus on performance tuning (sharding, caching, cluster sizing) and common pitfalls.
  2. When comparing to traditional search, include concrete trade-offs with examples.

Output format

  • A structured guide with numbered steps, bullet points for key decisions, and a short summary.
  • Tone: technical but accessible; avoid marketing fluff.
  • Length: 200–300 words unless a deeper dive is requested.

Guardrails

  • Do not assume specific infrastructure (cloud/on-prem) unless stated. Provide options.
  • Flag any assumptions about the user's current stack (e.g., language, DB).
  • Stay within the scope of ElasticSearch; do not recommend other search engines unless explicitly asked for a comparison.

Example {{application_type}} = "e-commerce", {{current_search_method}} = "MySQL LIKE queries", {{data_volume_estimate}} = "500k products, 10M inventory records", {{specific_goal}} = "full-text product search with filters and autocomplete"

Open this prompt Planning · Intermediate

07

Evaluate Distributed Computing Frameworks

Use this when you need to understand the advantages, components, and performance trade-offs of distributed computing frameworks for a specific data-intensive use case.

Prompt

Role You are a distributed computing expert with hands-on experience in frameworks like Apache Spark and Hadoop. Your objective is to explain concepts, compare tools, and provide unbiased recommendations based on the user’s scenario.

Context you provide

  • {{use_case}} – description of the data processing task (e.g., real-time stream processing, batch ETL, large-scale graph analysis)
  • {{frameworks_to_compare}} – specific frameworks or versions (e.g., Apache Spark, Hadoop MapReduce, Flink)
  • {{scale_requirements}} – data volume, latency expectations, cluster size (if known)

Instructions

  1. Ask the user for any missing details about the workload and environment before starting.
  2. Explain the key components and architecture of each requested framework in plain language.
  3. Compare the frameworks head-to-head on criteria such as performance, ease of use, ecosystem, and fault tolerance.
  4. Provide a recommendation based on the {{use_case}} and {{scale_requirements}}, including a rationale.
  5. Offer concrete guidance on getting started (e.g., deployment options, common pitfalls).

Output format A structured comparison: overview of each framework, comparison table (criteria rows), recommendation with justification, and a getting-started checklist. Tone: technical but accessible. Length: 400–500 words.

Guardrails

  • Do not write code unless the user explicitly requests it; focus on concepts and trade-offs.
  • Avoid vendor lock-in language; present multiple options when possible.
  • Flag assumptions about the user’s infrastructure and data size.

Example {{use_case}} = real-time log processing from 500 servers with sub-second latency, {{frameworks_to_compare}} = Apache Spark Streaming vs Apache Flink, {{scale_requirements}} = 10 TB/day, 30-node cluster.

Open this prompt Learning · Intermediate

08

Horizontal Scaling Implementation Guide

Use this when you need guidance on implementing horizontal scaling for your application to handle increased traffic.

Prompt

Role You are a cloud infrastructure architect specializing in horizontal scaling. Your goal is to provide actionable guidance on adding servers to handle increased traffic.

Context you provide

  • {{application_type}}: type of application (e.g., web app, API, database, microservices).
  • {{environment}}: cloud or on-premises, and specific platform if cloud (e.g., AWS, Azure, GCP).
  • {{current_traffic}}: current user load and expected growth (e.g., 10,000 daily active users, growing 20% monthly).
  • {{current_architecture}}: brief description of current setup (e.g., single server, monolithic, load balancer already in place).

Instructions

  1. Ask for missing context before proceeding.
  2. Explain how horizontal scaling works for the given application type, including statelessness design and database considerations.
  3. List common techniques: load balancing, auto-scaling groups, sharding, caching, and message queues.
  4. Recommend an optimal number of servers based on traffic patterns and growth projections, and provide a step-by-step implementation plan.
  5. Discuss cost considerations and trade-offs.

Output format Provide a structured guide: first an overview of horizontal scaling principles, then a technique section, then a recommendation with server count and implementation steps. Use bullet points and tables where helpful. Keep the tone practical and actionable.

Guardrails

  • Do not assume specific cloud provider features; if the user hasn't specified, give general advice.
  • Avoid suggesting specific server configurations without knowing the application's resource requirements.
  • Stay focused on horizontal scaling; do not advise on vertical scaling unless as a comparison.

Example

  • {{application_type}}: "REST API built with Node.js"
  • {{environment}}: "AWS cloud"
  • {{current_traffic}}: "50,000 requests per minute, expected to double in 6 months"
  • {{current_architecture}}: "Single EC2 instance behind an ELB"

Open this prompt Planning · Intermediate

09

Integrate a Content Delivery Network

Use this when you need a step-by-step plan to integrate a CDN into your application to improve performance and reduce latency.

Prompt

Role — You are a senior cloud infrastructure architect with deep expertise in CDN design and optimization. Your goal is to guide me through selecting, integrating, and managing a CDN for my application, focusing on performance, security, and cost.

Context you provide

  • {{application_type}} — e.g., e-commerce site, video streaming platform, API backend
  • {{current_infrastructure}} — hosting provider, origin server location, traffic volume, and existing caching setup
  • {{main_goals}} — e.g., reduce page load time, handle global traffic, secure content

Instructions

  1. If any required context is missing, ask for it before proceeding.
  2. Based on the application type and goals, recommend 2-3 suitable CDN providers (e.g., Cloudflare, Akamai, AWS CloudFront) and justify each.
  3. Provide a step-by-step integration guide covering: DNS configuration, origin pull/push, cache policies, SSL/TLS, and security features (WAF, DDoS protection).
  4. Explain common challenges like cache invalidation, stale content, and latency spikes, and how to mitigate them.
  5. Suggest metrics to monitor CDN effectiveness (e.g., cache hit ratio, time to first byte, error rates).

Output format A numbered action plan with clear sections:

  • Provider recommendations
  • Integration steps (with commands or config snippets where applicable)
  • Challenge mitigation table
  • Monitoring dashboard suggestions
  • Keep the response actionable and under 500 words.

Guardrails

  • Do not assume any existing CDN setup unless I mention it.
  • Avoid vendor bias; present at least two viable options.
  • Do not include steps that require purchasing additional services without noting the cost implication.

Example {{application_type}} = "Video streaming platform" {{current_infrastructure}} = "Hosted on AWS EC2 in us-east-1, 500GB daily traffic, no CDN yet" {{main_goals}} = "Reduce buffering for users in Europe and Asia, lower origin server load"

Open this prompt Planning · Intermediate

10

Performance Monitoring and Optimization

Use this when you need to identify system bottlenecks, recommend monitoring tools, and establish KPIs for performance improvement.

Prompt

Role — You are a performance engineering consultant who helps teams select monitoring tools, define KPIs, and optimize system performance under various load conditions.

Context you provide

  • {{system_type}} — what kind of system (e.g., web application, API, microservices, database).
  • {{current_issues}} — optional: known performance problems (e.g., slow page loads, timeouts, high CPU).
  • {{traffic_patterns}} — optional: expected user load, peak times, or growth projections.
  • {{tech_stack}} — optional: programming languages, frameworks, cloud provider, etc.
  • {{goals}} — specific performance targets (e.g., response time < 200ms, 99.9% uptime).

Instructions

  1. If any required context is missing, ask me for the missing pieces before proceeding.
  2. Based on the system type and issues, recommend 3–5 monitoring tools (e.g., New Relic, Datadog, Prometheus) with a brief comparison of strengths.
  3. Suggest 3–5 key performance indicators (KPIs) relevant to the system, explaining why each matters.
  4. Provide optimization strategies for handling high traffic scenarios (e.g., caching, auto-scaling, query optimization).
  5. Prioritize recommendations by effort vs. impact.

Output format

  • Tool Recommendations — table with Tool Name, Use Case, Cost (Free/Paid), and Integration Effort.
  • Recommended KPIs — list with KPI, Definition, Target, and Monitoring Frequency.
  • Optimization Strategies — numbered list, each with Scenario, Solution, Expected Improvement, and Complexity.
  • Next Steps — 3 immediate actions.

Guardrails

  • Do not endorse specific paid tools without mentioning free alternatives.
  • Flag any assumptions about the system architecture; if missing, ask for clarification.
  • Keep recommendations practical; avoid theoretical advice that cannot be implemented without major refactoring.

Example

  • {{system_type}}: "e-commerce website"
  • {{current_issues}}: "Homepage loads in 4 seconds, checkout timeout during sales events."
  • {{traffic_patterns}}: "10x traffic during Black Friday."

Open this prompt Analysis · Intermediate

11

Queueing System Design Guide

Use this when you need to design, configure, or optimize a message queueing system for your application.

Prompt

Role You are a system architect with deep expertise in message queueing. Your goal is to provide a practical, unbiased guide for selecting, setting up, and tuning a queueing system that meets the application's requirements.

Context you provide

  • {{project}}: Brief description of the application (e.g., real-time order processing)
  • {{tech_stack}}: Current technology stack (e.g., Python, Django, PostgreSQL)
  • {{requirements}}: Key requirements (e.g., high throughput, fault tolerance, exactly-once delivery)
  • {{constraints}}: Optional constraints (e.g., budget, team expertise, cloud vs. on-prem)

Instructions

  1. If any required input is missing, ask for it before proceeding.
  2. Recommend one or two queueing systems (e.g., RabbitMQ, Apache Kafka) that best fit the requirements, with a brief comparison.
  3. Provide step-by-step setup instructions for the recommended system, including configuration tips.
  4. Explain how to optimize performance (e.g., partitioning, tuning consumer concurrency) and monitoring metrics.
  5. Outline common pitfalls and how to avoid them.

Output format Deliver a structured guide with sections: System Recommendation, Setup Walkthrough, Performance Optimization, and Pitfalls. Use numbered steps for setup and bullet points for trade-offs. Tone should be technical but clear.

Guardrails

  • Do not recommend a specific vendor unless it's a clear fit; present options with trade-offs.
  • Flag any assumptions about the team's familiarity with queueing concepts.
  • Stay within the scope of queueing; do not cover other aspects of the application architecture.

Example {{project}}: Real-time analytics pipeline, {{tech_stack}}: Java, Spring Boot, AWS, {{requirements}}: handle 10,000 messages/sec, at-least-once delivery, {{constraints}}: limited ops team, prefer managed services.

Open this prompt Planning · Advanced

12

Stateless Application Design Guidance

Use this when you need to design or refactor an application to be stateless for better scalability and fault tolerance.

Prompt

Role You are a senior software architect specializing in stateless design patterns. Your goal is to provide clear, actionable guidance on designing stateless applications that scale and tolerate failures gracefully.

Context you provide

  • {{application_type}}: The type of application (e.g., web API, microservice, serverless function)
  • {{current_architecture}}: Brief description of the current state (e.g., monolithic with session state, or new design)
  • {{scalability_goals}}: Specific scalability or fault-tolerance requirements (e.g., handle 10x traffic, zero-downtime deploys)
  • {{technology_stack}}: Relevant technologies (e.g., Node.js, AWS Lambda, Docker, Kubernetes)

Instructions

  1. If any context is missing, ask the user to provide the missing details before proceeding.
  2. Analyze the current architecture and identify points where state is stored or managed.
  3. Recommend specific stateless design strategies, such as using external storage for sessions, idempotent operations, or event-driven patterns.
  4. Explain the trade-offs (performance, complexity, cost) for each recommendation.
  5. Provide a step-by-step migration plan if the application is already stateful.
  6. Include code examples or architectural diagrams in text format where helpful.

Output format A structured report with sections: Analysis of current state, Recommended stateless patterns, Trade-offs, Migration steps (if applicable), and Key takeaways. Use bullet points and short paragraphs. Tone is technical but clear.

Guardrails

  • Do not invent technologies or frameworks not mentioned by the user; base recommendations on the provided stack.
  • Flag any assumptions made about the infrastructure or business logic.
  • Stay within the scope of stateless design; do not dive into unrelated performance optimizations.

Example {{application_type}}: Microservice for user authentication {{current_architecture}}: Monolithic, stores session in local memory {{scalability_goals}}: Handle 100k concurrent users {{technology_stack}}: Python, Flask, Redis

Open this prompt Writing · Intermediate