skillcraft.All articlesRU

FROM THE AI FRONTIER

Frontline news — November 22: compare AI with its tools in mind

A fresh AI Engineer talk is a reason to check how you compare assistants. Make a card recording the task, input and available tools.

Skillcraft editorial team · Max character · 2026-11-22

Two laptops and a checklist for checking tools available to local and online AI.

Before comparing local AI with an online assistant, check whether they have the same tools available. I would start with web search: without it, a comparison may answer a different question from the one you intended.

Video: models need tools too

Original: What Runs Where? Local AI in Production — Ahmad Osman, Osmantic.

In the 32:59–34:34 passage, Osman describes a friend whose local model could not change a graphics card’s lighting. He says the assistant initially lacked web search; after search was connected, the task succeeded. This is the speaker’s account, not our test or proof that the models are equivalent.

Practical takeaway: check the comparison conditions

My practical suggestion is to make a short comparison card before choosing an assistant. You only need your task description and the settings of the applications you use; you do not need to install a local model for this exercise.

  1. Write down the task and what a finished result should look like.
  2. Note what solving it requires: your document, current information from the web, or access to an application.
  3. Check which of those tools are actually enabled for each assistant. If you do not know, mark the item “not confirmed.”
  4. Compare answers together with the conditions under which they were produced.

Fictional example: you need a museum’s opening hours for Sunday. On the card, write “official schedule for the relevant date” and “web search.” If one assistant reads the museum’s page while the other gets only its name, the exercise does not separate model quality from access to information.

Limitations

Connecting search does not guarantee a correct answer. Open the source and check its date and conditions. Do not change network settings or buy equipment based on one talk. We did not test the reported experience or compare device performance.

Sources

From the workshop