SUGILITE is a new programming-by-demonstration (PBD)
system that enables users to create automation on
smartphones. SUGILITE uses Android’s accessibility API to
support automating arbitrary tasks in any Android app (or
even across multiple apps). When the user gives verbal
commands that SUGILITE does not know how to execute,
the user can demonstrate by directly manipulating the regular
apps’ user interface. By leveraging the verbal instructions,
the demonstrated procedures, and the apps’ UI hierarchy
structures, SUGILITE can automatically generalize the
script from the recorded actions, so SUGILITE learns how to
perform tasks with different variations and parameters from
a single demonstration. Extensive error handling and context
checking support forking the script when new situations
are encountered, and provide robustness if the apps
change their user interface. Our lab study suggests that users
with little or no programming knowledge can successfully
automate smartphone tasks using SUGILITE.
Read more

What's New

Add support for Android 5.0
Read more

Additional Information

September 19, 2017
Varies with device
Current Version
Varies with device
Requires Android
Varies with device
Content Rating
Interactive Elements
Shares Info
Offered By
©2018 GoogleSite Terms of ServicePrivacyDevelopersArtistsAbout Google|Location: United StatesLanguage: English (United States)
By purchasing this item, you are transacting with Google Payments and agreeing to the Google Payments Terms of Service and Privacy Notice.