If you want to get the most out of the world -filled world from the AI tools, here’s a habit of developing a habit: start taking screenshots. Many screenshots. Of anything and everything. Because of the sound methods, the cameras of everything, and the multi -moodle of everything, all the future conversations cannot be more valuable digital treatment, suppressing the buttons and saving what you are seeing.
Screenshots are the most global way to capture digital information. You can capture anything – okay, almost anything, Thank you very much, Netflix! – With some clicks, and secure and share it almost any device, app, or person. “This is portable data format,” says Johnny Bari, founder of the digital storage app. Fabful. “There is nothing else that you can move between any piece of software.”
A screenshot contains a lot of information, such as its sources, contents, and even in the corner of the screen. Most of all, it sends an important and complex signal. It says I care about it. We have numerous new AI tools that aims to see the world, our lives and everything and try to understand it all for us. These tools are mostly nasty for many reasons, but mostly because AI is great to know what things are, but it is a trash to know if they make a difference. A screenshot assigns value and tells the system that needs to be addressed.
Screenshots you, also control the user in an important way. “If I provide you with access to all my emails, all my WhatsApp, everything, there’s a lot of noise,” says Matias Desert, head of smartphone marketing. There is no reason to save every email you receive or every web page you receive – and it’s nothing about privacy implications. “So what if, instead, you were able to train the system itself, feed your information to your information Want System to learn about you? Instead of a tool like Microsoft’s memory, which demands unlimited access to everything, starting with screenshots allow you to select your share.
So far, screenshots have been quite a two -sided device. You snatch one, and it is saved in your camera roll, where by the end of time it may slow down, forget. (And not accidentally, do not start on all your lock screen -related screenshots.) Best, you may be able to find some text inside the icon. But it is more likely that you will have to scroll until you get it again.
The first step to make screenshots more useful is to find out what is actually in them
The first step to make screenshots more useful is to find out what is actually in them. This, on the first embarrassment, is not very complicated: Optical character identification technology has long done a good job of finding the text on a page. AI models take this one step forward, so you can find either title or just “movies” to find all your digital snaps of your posters, fanding results, tectic recommendations, and more. “We use an OCR model,” says Shinaz Zack, a part of the team behind the product manager and a pixel screenshots app in Google. “Then we use an entity detection model, and then use Gemini to understand the original screen context.”
Look, just more for a screenshot than inside the text. The correct AI model should be able to say that it came from WhatsApp, only through a specific green color. It should be able to identify or understand a website when you are saving the name of a spatheph song, Yelp Handmeen Review, or Amazon Listing. Equipped with this information, the screenshot app can start organizing all these images for you. And even this is just the beginning.
With everything I mentioned so far, what we have made is a very good app to see your screenshots, which no one really thinks is a good idea because it’s just another thing to check – or forget to check. Where it becomes very interesting when your device or app can actually begin to use screenshots from you, to help you remember whether you have received what you have received or to equip this information. Also use.
For example, in the new mandatory space app of anything, the app can create reminders of you -saving things. If you take a screenshot of a concert that you want to go, it reminds you that it is coming out automatically. Pixel screenshots are pushing the idea: If you save a concert list, your pixel phone can indicate the next time you open the spotifies. If you screenshot an ID card or boarding pass, it may ask you to put it in the wallet app. Zack says the idea is to think about screenshots as a input system for everything.
Mike Choi, an indie developer, created an app named Camp Partternly help use its own screenshots. He began to work on turning each screenshot into a “card”, with the picture stored along with the picture. He says, “You have a screenshot, and a button below, and this card turns.” “This shows you a map, if it was a place. The preview of a song, if it was a song. It was an idea, an infinite pond of a variety of screenshots was given, can AI just produce the perfect UI for this category on the fly?”
If all this seems familiar, the reason is that there is another term for what is happening here: it is called Agency AI. It seems that every company in Tech is working on AI’s use methods to meet things by you. That is, in this case, you don’t have to write long indicators with an assistant or chat back and forth. You just take a screenshot and let the system go to work. The desert says, “You are building the basis of knowledge, when today the basis of knowledge is limited to your gallery and nothing happens to it.” She is very excited to reach the location where you screen the date of the concert, and the necessary space automatically indicates you to buy tickets when they go on sale.
The feeling of screenshots is not always so straight
Although it is not always straightforward to make a sense of screenshots. Something you want to keep forever, like an identity card you can often need. Other things, such as a concert poster or parking pass, have a very limited life of the shelf. In this case, how to distinguish an app between the parking pass that you use at work every day and the one you used at the airport once and never need it again? Some screenshots on my phone were sent to me to WhatsApp. I caught Instagram Mems to send others to friends. No one’s camera roll should be fully placed against them, and the same is the case for screenshots. Many of these screenshot apps are looking for you to add notes, or manage things yourself to provide some additional helpful information to the system. But it is difficult to do that without destroying it that makes screenshots so smooth and easier.
One way to start this problem is to collect some additional contexts from your device to make screenshots more useful, to automatically use the screenshots. This is a place where companies like Google do not benefit: Because they make the device, you can see everything that you take screenshots. If you catch a screenshot from your web browser, they can also store the link they were watching. They can also see your physical location or note the time and the weather. Sometimes this is all useful, but sometimes it is nonsense. The more data they collect, the more these apps are at risk of running the same noise that helped the screenshots help solve the first place.
But the input system works. We all take screenshots all the time, and we are accustomed to taking them as a way to marketing a lot of useful information. Accessing such related, personal figures is the most difficult thing about building a great AI assistant. The future of computing is definitely multi -modal, which includes cameras, microphones, and all kinds of sensors. But the first best way to use AI can be a screenshot at a time.
