FieldDay

FieldDay is an iPhone app from New Material, Inc. for building custom, camera-driven experiences powered by vision AI, with no code required. Users train their own image recognition model on the phone in minutes and use it for fun, educational or productive projects. FieldDay is meant for people with an idea for a camera-based tool who are not data scientists.

A user collects example images for each category with the camera, trains the algorithm and corrects it whenever it gets something wrong, which fine-tunes the vision AI model. Once trained, the model recognizes those categories through the camera. It can be exported to other platforms, or actions can be attached to it inside FieldDay so that a recognized category does something.

For home automation, FieldDay connects HomeKit-enabled devices to its categories, so the Apple Home can be controlled with the camera; lights, outlets, fans and scenes are supported. FieldDay also works with Siri Shortcuts and returns model predictions for images inside Shortcuts. Models can be exported to a range of popular tools and formats for use in larger projects and workflows.

FieldDay is free: version 1.2.0 removed subscriptions and in-app purchases, and all features are free. The app is only for iPhone, requires iOS 16.0 or later and is in English. According to the developer, contact info may be collected and linked to the user, while diagnostics may be collected without being linked to the user's identity.

Use cases

• Controlling HomeKit lights, outlets and fans by pointing the phone camera
• Building fun or educational camera-based experiences without writing code
• Training an image classifier to export into a larger project or workflow
• Adding image predictions to Siri Shortcuts automations
• Prototyping a vision AI idea without data science skills