Giter VIP home page Giter VIP logo

ios-bootstrap's Introduction


Lobe is a free, easy to use app that has everything you need to bring your machine learning ideas to life. The iOS starter project takes the machine learning model created in Lobe, and adds it to an iOS project. To get started using the starter project, follow the instructions below:

Get Started

  1. Clone, fork or download the project on your computer and install Xcode to get started. Xcode is the app that's used to run the starter project on your computer or device.

  2. When the installation of Xcode is complete, open the Lobe_iOS.xcodeproj file. Notice that we've added a sample model called LobeModel.mlmodel in the same folder as your starter project. This model recognizes common objects on your desk.

  3. To use your own model file, open your Lobe project, go to the Use tab, select Export and click on the Core ML model file. When exported, rename the .mlmodel file to LobeModel.mlmodel and drag it to the original starter project folder.

  4. Head back to Xcode and run the app by clicking on the play button. Consult the following section to run your project directly on your iPhone, otherwise ensure you select a simulator as a target device.

Running on Personal Device

The following requirements must be met in order to run the Lobe app on your device:

  1. Apple developer account subscription. You must link your developer account subscription in Xcode under the preferences panel.

  2. Create a unique bundle identifier. Create your own unique ID under Targets > General tab > Bundle Identifier in the project settings.

  3. Register device with developer account. Follow Apple's docs for adding your own device.

Additional Information

The iOS starter project supports a swipe up gesture to open the image picker, a double tap to toggle between the front and rear camera, and a triple tap to save a screenshot of the app that omits the UI components on top of it.

The project works on iPhones running iOS 13.4 or later. To dive deeper in the code and understand it better, check out our dedicated guide.

Contributing

GitHub Issues are for reporting bugs, discussing features and general feedback on the iOS starter project. Be sure to check our documentation, FAQ and past issues before opening any new ones.

To share your project, get feedback on it, and learn more about Lobe, please visit our community on Reddit. We look forward to seeing the amazing projects that can be built, when machine learning is made accessible to you.

ios-bootstrap's People

Contributors

adammenges avatar billba avatar ellbosch avatar jakecohenmicrosoft avatar ramongilabert avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

ios-bootstrap's Issues

Future work for iOS-bootstrap

Tracking changes to u/elbosc/main branch:

  • Open Screen
    • Import model
    • Switch between models
    • Delete models
    • Name and rename projects
    • Update folder path schema for saving projects
  • Play View
    • Taskbar buttons for flipping camera, photo picker
    • Camera zoom
  • Bugs
    • Landscape orientation doesn't work with camera
    • Flip camera not working
    • Fix orientation and cropping issues with images sent to prediction
    • Fix screenshot functionality to save the image sent as input for processing
    • Fix "image not found" logs
    • Squared image for image preview doesn't appear to be perfectly centered for portrait orientation
  • Refactoring
    • Move prediction and view model logic out of view controller
    • Hook project picker import to view model
    • Move capture session logic out of view controller
    • Remove frame-rate check
  • Engineering Systems
    • CI pipeline
    • Environment variable for viewing image sent for inference
    • Linting
    • Unit testing
  • Polish
    • Set tint to Lobe Green
    • Consider remove stack list style for open screen list
    • Remove header background that appears on landscape mode for iPhone
    • Add UI transition animation for camera flip
    • Update icon to new logo
    • Loading screens for launch, open screen, and play view
    • Handling errors in all views
  • Docs
    • Update README's with new files

Prediction on still images has worse performance on iOS than on Lobe desktop

Hello, love the app, first of all. This is how training should be!

I did run into a snag: I've successfully trained the model to recognize screenshots from audible, youtube, and apple podcasts and that model works very well on desktop using the "Play" section.

However, when I export the model and use it in the iOS Bootstrap, it does very bad at recognizing any screenshot accurately.

All I've done with code is replaced LobeModel with SavedModel directly from Lobe.

Any suggestions?

Video demo link: https://www.youtube.com/watch?v=_rtKnlmsxzM

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.