Cloudflare + AI

The future of apps is AI

Build better assistive and generative AI apps on the Cloudflare global network.

Run fast, low-latency inference tasks

Use curated, pre-trained, and verified machine learning models or, train and upload your own with Constellation.
See it in action in the following demos.

Generate human-readable tags for images with SqueezeNet, and ImageNet.

GitHub

import { Tensor, InferenceSession, TensorType } from "@cloudflare/constellation";

const input = await decodeImage(data);
const session = new InferenceSession(env.CLASSIFIER, "a785280...");
const tensorInput = new Tensor(TensorType.Float32, input, { shape: [1, 3, 224, 224] });
const predictionTensor = Object.values(await session.run([tensorInput]))[0];
const softmaxResult = softmax(predictionTensor.value);
const results = topClasses(softmaxResult, 5);

Use a sample image, upload or drop it here

Result

Calculate the sentiment of an English sentence with distilbert-base-uncased-finetuned-sst-2-english .

GitHub

import { Tensor, InferenceSession, TensorType } from "@cloudflare/constellation";

const pipeline = await pipeline("sentiment-analysis");
/*
  "sentiment-analysis": {
      "tokenizer": AutoTokenizer,
      "pipeline": TextClassificationPipeline,
      "model": AutoModelForSequenceClassification,
      "default": {
          "model": "distilbert-base-uncased-finetuned-sst-2-english",
      },
      "type": "text",
  },
*/
const results = await pipeline([ input ], {topk: topk});

Input

Result

Compare the similarity of multiple sentences to a control sentence with all-MiniLM-L6-v2 .

GitHub

import { Tensor, InferenceSession, TensorType } from "@cloudflare/constellation";

const pipeline = await pipeline("embeddings");
/*
  "embeddings": {
      "tokenizer": AutoTokenizer,
      "pipeline": EmbeddingsPipeline,
      "model": AutoModel,
      "default": {
          "model": "sentence-transformers/all-MiniLM-L6-v2"
      },
      "type": "text",
  },
*/
const results = await pipeline([query].concat(value));

Input

Result

Translate an English sentence to French, German, or Romanian with the t5-small model.

GitHub

import { Tensor, InferenceSession, TensorType } from "@cloudflare/constellation";

const pipeline = await pipeline("translation");
/*
  "translation": {
      "tokenizer": AutoTokenizer,
      "pipeline": TranslationPipeline,
      "model": AutoModelForSeq2SeqLM,
      "default": {
          "model": "t5-small"
      },
      "type": "text",
  },
*/
const results = await pipeline(`translate ${config.inputLanguage} to ${config.outputLanguage}: ${input}`, { max_new_tokens: max_tokens });

From:To:

Result

Develop on Cloudflare

Start building with these tutorials

Build your own ChatGPT plugin
Create custom extensions with Workers to make Chat GPT even more powerful.
Build an image classification application
Deploy a Worker that tags images using pre-trained models in Constellation.
Build an app to load and query content
Use LangChain and Workers to ask a question of a wikipedia article.
Pull real-time data from a URL
Receive a prompt from OpenAI to call a function within your code to add to the conversation.

You're in good company

See what AI apps are running on Cloudflare

Character.AI
Character AI is building the next generation of dialog agents across industries spanning entertainment, education, and more. R2 has been the glue behind our multi-cloud architecture for training and processing requests. We are now able to store our training and production data in R2 for access by any cloud, without egress fees, and get the best prices and performance across multiple cloud providers. Cloudflare is helping us rapidly expand our infrastructure and envision the future of conversational AI.
— Myle Ott, Founding Researcher
built using...
- Workers
- R2
Leonardo.Ai
Leonardo.ai brings AI-powered creative tools to users like indie game developers and creators. After launching, our explosive growth was a near existential crisis – the exorbitant data transfer costs from other providers were not sustainable for an early stage, high-growth startup in a data intensive space. Cloudflare’s R2 saved the day. The API compatibility meant switching over our apps was a breeze, with minimal engineering effort. The dashboard tool for migrating our existing data worked flawlessly. And the pricing is unbeatable, the best we found both on a per-GB and egress cost basis.
— Pete Werner, Head of AI
built using...
- R2
Lexica
Lexica's users are generating millions of images per month, letting them unleash their creativity and express themselves in new ways. Lexica.art wouldn't be possible without R2 and Workers. Using these products has given us a lot of control over the images we serve and helps us keep the website snappy and responsive. With the number of requests we serve, it would easily cost 100x more on Amazon.
— Sharif Shameem, Founder
built using...
- Workers
- R2
SiteGPT
SiteGPT is working to make personalized chatbots accessible to every website. We use Cloudflare for everything – storage, cache, queues, and most importantly for training data and deploying the app on the edge, so I can ensure the product is reliable and fast. It's also been the most affordable option, with competitors costing more for a single day's worth of requests than Cloudflare costs in a month. The power of the developer platform and performance tools made it an easy choice to build with Cloudflare.
— Bhanu Teja Pachipulusu, Founder
built using...
- Queues

View all

Workers Launchpad participants

GPUX
GPUX is solving the problem of providing GPUs for training and inference.
Quest AI
Automatically generate front-end code for Pages with Quest AI.
Targum Video
See how Targum is translating videos to remove language barriers with Stream.

Join the program

Build faster with Cloudflare AI

What repositories are popular on GitHub?
Here are some of the most popular repositories on GitHub, based on the number of stars:
- freeCodeCamp - Learn to code for free. (364,408 stars)
- free-programming-books - Free programming books. (275,963 stars)
- 996.ICU - Repo for counting stars and contributing. (265,543 stars)
Please note that the number of stars may have changed since my knowledge cutoff date.
Developer Docs Chat GPT plug-in
Get up-to-date product information from our developer documentation in ChatGPT.
What's the HTTP protocol version distribution in Portugal?
The percentage distribution of traffic per HTTP protocol version in Portugal for the past 14 days is as follows:
- HTTP/2: 54.81%
- HTTP/3: 24.35%
- HTTP/1.x: 20.84%
Please note that these percentages are approximations and the actual values may vary slightly.
Cloudflare Radar Chat GPT plug-in
Retrieve data from Radar within ChatGPT with this plugin.

Meet your AI assistant, Cursor

Cursor is an experimental AI assistant, trained to answer questions about Cloudflare's Developer Platform and powered by Cloudflare Workers and Durable Objects. Cursor is here to help answer your Cloudflare Workers and Developer Platform questions, so ask away!

Speak with Cursor

Learn more

Hear from two founders on how they are building with AI on Cloudflare on this CloudflareTV segment.
If you’re an AI startup apply to be a part of the Cloudflare Startup Program.
Join the Developers Discord to chat with your peers about building AI applications with Cloudflare.

Build locally, scale globally.

Start Building