Model comparison

Fugu Ultra v2 vs Llama 3.1 8B Instruct

Pricing, context window and real answers (September 2026)

Fugu Ultra v2 (Sakana AI) and Llama 3.1 8B Instruct (Meta), compared as you can actually call them on FastMetal. Both are served from the same OpenAI-compatible endpoint and API key; switching is a change to the model string.

Specs and pricing

Fugu Ultra v2meta-llama logoLlama 3.1 8B Instruct
ProviderSakana AIMeta
Input (per 1M tokens)¥893.5¥8.94
Output (per 1M tokens)¥5,361¥14.3
Typical cost (1,000 in + 500 out tokens × 1,000 calls)¥3,574¥16
Context window1,000,000 tokens131,072 tokens
Release date9/11/20267/23/2024
Input modalitiestext, image, filetext
Throughput (p50)
Arena · overallUnranked#329 · ELO 1,211
Arena · JapaneseUnranked#243 · ELO 1,087
Arena · codingUnranked#323 · ELO 1,260

Prices are FastMetal's yen rates before tax. Arena ranks are as of the latest leaderboard scrape.

Which should you pick?

  • On price, Llama 3.1 8B Instruct: ¥14.3 per 1M output tokens, 100% less than Fugu Ultra v2.
  • For long documents, Fugu Ultra v2: a 1,000,000-token context window against 131,072 for Llama 3.1 8B Instruct.
  • If in doubt, try both on the same key. Switching is a change to the model string, and each is billed at its own rate.

Real answers to the same prompts

Exactly what the FastMetal gateway returned, side by side. Not benchmark scores: actual output.

Count the number of 'r's in 'strawberry'

Count the number of 'r's in 'strawberry'. Explain your reasoning step by step.

Fugu Ultra v2

**Answer: 3** **Step-by-step reasoning:** 1. **Write out the word letter by letter**, assigning each a position: | Position | Letter | Is it 'r'? | |---|---|---| | 1 | s | no | | 2 | t | no | | 3 | **r** | ✅ yes | | 4 | a | no | | 5 | w | no | | 6 | b | no | | 7 | e | no | | 8 | **r** | ✅ yes | | 9 | **r** | ✅ yes | | 10 | y | no | 2. **Tally the matches:** positions 3, 8, and 9 are 'r'. 3. **Sanity check by chunks:** "straw" contains one 'r' (str**a**w → the r in "str"), and "berry" contains two 'r's (be**rr**y). 1 + 2 = 3. 4. **Verify length:** the letters counted total 10, which matches the length of "strawberry" — so no letter was skipped or double-counted. **Conclusion:** There a…
10.2s435 output tokens

Llama 3.1 8B Instruct

To count the number of 'r's in 'strawberry', I will break down the word into its individual letters and examine each one. Here's the step-by-step process: 1. The word 'strawberry' consists of the following letters: s-t-r-a-w-b-e-r-r-y. 2. I will start by counting the letters that are not 'r'. The word has 1 's', 1 't', 1 'a', 1 'w', 1 'b', 1 'e', 1 'y'. 3. Next, I will count the number of 'r's. The word has 2 'r's, one of which is part of the letter combination 'rr'. Therefore, there are 2 'r's in the word 'strawberry'.
9.7s169 output tokens

Debug This Error

I'm getting the following error in my Node.js application: TypeError: Cannot read properties of undefined (reading 'map') at UserList (/app/components/UserList.js:12:25) at renderWithHooks (/app/node_modules/rea…

Fugu Ultra v2

## What the error means `TypeError: Cannot read properties of undefined (reading 'map')` means that when `UserList` rendered, `users` was `undefined`, and JavaScript can't read the `.map` property off `undefined`. The important detail: **the bug isn't really in `UserList`** — that's just where it surfaces. Destructuring `function UserList({ users })` does *not* throw when the prop is missing; it silently gives you `undefined`. The crash is deferred to the first property access, which is `.map` on line 12. So the real question is: why is `props.users` not an array? ## Why `users` is undefined **1. Async data hasn't arrived yet — by far the most common cause.** ```jsx const [users, setUs…
70.8s5286 output tokens

Llama 3.1 8B Instruct

The error `TypeError: Cannot read properties of undefined (reading 'map')` typically occurs when you're trying to access a property (in this case, `map`) on an object that is `undefined`. In your case, the `users` prop passed to the `UserList` component is `undefined`. This is likely because the parent component that renders `UserList` is not passing the `users` prop, or the prop is not being properly initialized. To fix this error, you can add a simple check to ensure that `users` is not `undefined` before trying to call `map` on it: ```javascript function UserList({ users }) { if (!users) return null; // or return a default message, e.g. "No users found" return ( <ul> {us…
7.9s292 output tokens

Code Review

Please review the following Python function and suggest improvements for readability, performance, and best practices: def get_data(url, retries=3): import requests import time for i in range(retries):…

Fugu Ultra v2

# Final Code Review: `get_data` The function is compact and its intent is clear, but as written it will **fail silently in production**. Two defects dominate everything else: 1. The bare `except:` swallows every error — including `KeyboardInterrupt` and genuine logic bugs. 2. A total failure and a legitimately empty dataset both return `[]`, so callers cannot tell "the service is down" from "there are no active records." Together these mean an outage looks exactly like a successful empty response. Everything else below is meaningful improvement; those two are the difference between code that fails loudly and code that fails invisibly. --- ## 1. Correctness and error handling ### 1.1 `e…
281.1s23317 output tokens

Llama 3.1 8B Instruct

Here are some suggestions for improving the function's readability, performance, and best practices: **Readability Improvements** 1. **Function name**: Consider renaming `get_data` to `fetch_active_items` to better reflect its purpose. 2. **Variable naming**: Use more descriptive variable names, such as `response` instead of `r`, and `active_items` instead of `result`. 3. **Code organization**: Break up the function into smaller, more focused sections. This will improve readability and make it easier to understand the logic. 4. **Type hints**: Add type hints for function parameters and return types to make the code more self-documenting. **Performance Improvements** 1. **Use a more effic…
29.7s533 output tokens

Compare on more prompts →

Frequently asked questions

Which is cheaper, Fugu Ultra v2 or Llama 3.1 8B Instruct?
Per 1M output tokens, Fugu Ultra v2 is ¥5,361 and Llama 3.1 8B Instruct is ¥14.3 on FastMetal (yen, before tax), so Llama 3.1 8B Instruct is cheaper.
How do the context windows of Fugu Ultra v2 and Llama 3.1 8B Instruct compare?
Fugu Ultra v2 takes 1,000,000 tokens; Llama 3.1 8B Instruct takes 131,072.
Can I use Fugu Ultra v2 and Llama 3.1 8B Instruct with the same API key?
Yes. On FastMetal's OpenAI-compatible endpoint, switch by passing "fugu-ultra-v2" or "llama-3.1-8b-instruct" as the model. Each is billed at its own rate from the same prepaid balance.

Try both on one API key

Create an account and add credit to call Fugu Ultra v2 and Llama 3.1 8B Instruct from the browser chat and the API. No monthly fee.

More comparisons with Fugu Ultra v2

More comparisons with Llama 3.1 8B Instruct