OtoSense: the next level in sound-based IoT

Posted on 3rd August 2017 in automotive, data, Internet of Things, maintenance, mobile, sensors, transportation

It sounds (pardon the pun) as if the IoT may really be taking off as an important diagnostic repair tool.

I wrote a while ago about the Auguscope, which represents a great way to begin an incremental approach to the IoT because it’s a hand-held device to monitor equipment’s sounds and diagnose possible problems based on abnormalities.

Now NPR reports on a local (Cambridge) firm, OtoSense, that is expanding on this concept on the software end. Its tagline is “First software platform turning real-time machine sounds and vibrations into actionable meaning at the edge.”

Love the platform’s origins: it grows out of founder Sebastien Christian’s research on deafness (as I wrote in my earlier post, I view suddenly being able to interpret things’ sounds as a variation on how the IoT eliminates the “Collective Blindness”  that I’ve used to describe our past inability to monitor things before the IoT’s advent):

“[Christian} … is a quantum physicist and neuroscientist who spent much of his career studying deaf children. He modeled how human hearing works. And then he realized, hey, I could use this model to help other deaf things, like, say, almost all machines.”

(aside: I see this as another important application of my favorite IoT question: learning to automatically ask “who else can use this data?” How does that apply to YOUR work? But I digress).

According to Technology Review, the company is concentrating primarily on analyzing car sounds from IoT detectors on the vehicle at this point (working with a number of car manufacturers) although they believe the concept can be applied to a wide range of sound-emitting machinery:

“… OtoSense is working with major automakers on software that could give cars their own sense of hearing to diagnose themselves before any problem gets too expensive. The technology could also help human-driven and automated vehicles stay safe, for example by listening for emergency sirens or sounds indicating road surface quality.

OtoSense has developed machine-learning software that can be trained to identify specific noises, including subtle changes in an engine or a vehicle’s brakes. French automaker PSA Group, owner of brands including Citroen and Peugeot, is testing a version of the software trained using thousands of sounds from its different vehicle models.

Under a project dubbed AudioHound, OtoSense has developed a prototype tablet app that a technician or even car owner could use to record audio for automated diagnosis, says Guillaume Catusseau, who works on vehicle noise in PSA’s R&D department.”

According to NPR, the company is working to apply the same approach to a wide range of other types of machines, from assembly lines to DIY drills. As always with IoT data, handling massive amounts of data will be a challenge, so they will emphasize edge processing.

OtoSense has a “design factory” on the site, where potential customers answer a variety of questions about the sounds they must monitor (such as whether the software will be used indoors or out, whether it is to detect anomalies, etc. that will allow the company to choose the appropriate version of the program.

TechCrunch did a great article on the concept, which underscores really making sound detection precise will take a lot of time and refinement, in part because of the fact that — guess what — sounds from a variety of sources are often mingled, so the relevant ones must be determined and isolated:

“We have loads of audio data, but lack critical labels. In the case of deep learning models, ‘black box’ problems make it hard to determine why an acoustical anomaly was flagged in the first place. We are still working the kinks out of real-time machine learning at the edge. And sounds often come packaged with more noise than signal, limiting the features that can be extracted from audio data.”

In part, as with other forms of pattern recognition such as voice, this is because it will require accumulating huge data files:

“Behind many of the greatest breakthroughs in machine learning lies a painstakingly assembled dataset.ImageNet for object recognition and things like the Linguistic Data Consortium and GOOG-411 in the case of speech recognition. But finding an adequate dataset to juxtapose the sound of a car-door shutting and a bedroom-door shutting is quite challenging.

“’Deep learning can do a lot if you build the model correctly, you just need a lot of machine data,’ says Scott Stephenson, CEO of Deepgram, a startup helping companies search through their audio data. ‘Speech recognition 15 years ago wasn’t that great without datasets.’

“Crowdsourced labeling of dogs and cats on Amazon Mechanical Turk is one thing. Collecting 100,000 sounds of ball bearings and labeling the loose ones is something entirely different.

“And while these problems plague even single-purpose acoustical classifiers, the holy grail of the space is a generalizable tool for identifying all sounds, not simply building a model to differentiate the sounds of those doors.

…”A lack of source separation can further complicate matters. This is one that even humans struggle with. If you’ve ever tried to pick out a single table conversation at a loud restaurant, you have an appreciation for how difficult it can be to make sense of overlapping sounds.

Bottom line: there’s still a lot of theoretical and product-specific testing that must be done before IoT-based sound detection will be an infallible diagnostic tool for predictive maintenance, but clearly there’s precedent for the concept, and the potential payoff are great!

 

LOL: as the NPR story pointed out, this science may owe its origins to two MIT grads of an earlier era, “Click” and “Clack” of Car Talk, who frequently got listeners to contribute their own hilarious descriptions of the sounds they heard from their malfunctioning cars.   BRTTTTphssssBRTTTT…..

comments: Comments Off on OtoSense: the next level in sound-based IoT tags: , , , , ,

A Vision for Dynamic and Lower-Cost Aging in Cities Through “SmartAging”

Posted on 22nd July 2017 in aging, cities, collaboration, data, government, health, home automation, Internet of Things, m-health, open data, paradigm shift, Quantified Self, seniors, services, smart cities, smart home, SmartAging, transportation, US government, wearables

I’ve been giving a lot of thought recently about how my vision of I0T-based “SmartAging” through a combination of:

  • Quantified Self health apps and devices to improve seniors’ health and turn their health care into more of a partnership with their doctors
  • and smart home devices that would make it easier to manage their homes and “age in place” rather than being institutionalized

could meld with the exciting developments in smart city devices and strategy.  I believe the results could make seniors happier and healthier, reduce the burdens on city budgets of growing aging populations, and spur unprecedented creativity and innovation on these issues. Here’s my vision of how the two might come together. I’d welcome your thoughts on the concept!

 

A Vision for Dynamic and Lower-Cost Aging in Cities Through “SmartAging”

It’s clear business as usual in dealing with aging in America won’t work anymore.  10,000 baby boomers a day retire and draw Social Security. Between now and 2050, seniors will be the fastest growing segment of the population.  How can we stretch government programs and private resources so seniors won’t be sickly and live in abject poverty, yet millennials won’t be bankrupted either?

As someone in that category, this is of more than passing interest to me! 

I propose a new approach to aging in cities, marrying advanced but affordable personal technology, new ways of thinking about aging, and hybrid formal and ad hoc public-private partnerships, which can deal with at least part of the aging issue. Carving out some seniors from needing services through self-reliance and enhancing their well-being would allow focusing scarce resources on the most vulnerable remaining seniors. 

The approach is made possible not only by the plummeting cost and increasing power of personal technology but also the exciting new forms of collaboration it has made possible.

The proposal’s basis is the Internet of Things (IoT).  There is already a growing range of IoT wearable devices to track health indicators such as heart rates and promoting fitness activities, and IoT “smart home” devices controlling lighting, heat, and other systems. The framework visualized here would easily integrate these devices, but they can be expensive, so it is designed so seniors could benefit from the project without having to buy the dedicated devices.

This proposal does not attempt to be an all-encompassing solution to every issue of aging, but instead will create a robust, open platform that government agencies, companies, civic groups, and individuals can build upon to reduce burdens on individual seniors, improve their health and quality of life, and cut the cost of and need for some government services. Even better, the same platform and technologies can be used to enhance the lives of others throughout the life spectrum as well, increasing its value and versatility.

The proposal is for two complementary projects to create a basis for later, more ambitious one.

Each would be valuable in its own right and perhaps reach differing portions of the senior population. Combined, they would provide seniors and their families with a wealth of real-time information to improve health, mobility, and quality of life, while cutting their living costs and reducing social isolation.  The result would be a mutually-beneficial public-private partnerships and, one hopes, improve not only seniors’ lives, but also their feeling of connectedness to the broader community. Rather than treat seniors as passive recipients of services, it would empower them to be as self-reliant as possible given their varying circumstances. They would both be based on the Lifeline program in Massachusetts (and similar ones elsewhere) that give low-income residents basic Internet service at low cost.

Locally, Boston already has a record of achievement in internet-based services to connect seniors with others, starting with the simple and tremendously effective SnowCrew program that Joe Porcelli launched in the Jamaica Plain neighborhood. This later expanded nationwide into the NextDoor site and app, which could easily be used by participants in the program.

The first project would capitalize on the widespread popularity of the new digital “home assistants,” such as the Amazon Echo and Google Home.  One version of the Echo can be bought for as little as $49, with bulk buying also possible.  A critical advantage of these devices, rather than home monitoring devices specifically for seniors, is that they are mainstream, benefit from the “network effects” phenomenon that means each becomes more valuable as more are in use, and don’t stigmatize the users or shout I’M ELDERLY. A person who is in their 50s could buy one now, use it for routine household needs, and then add additional age-related functions (see below) as they age, amortizing the cost.

The most important thing to remember about these devices regarding aging is the fact that they are voice-activated, so they would be especially attractive to seniors who are tech-averse or simply unable to navigate complex devices. The user simply speaks a command to activate the device.

The Echo (one presumes a variation on the same theme will soon be the case with the “Home,” Apple’s forthcoming “Home Pod” and other devices that might enter the space in the future) gets its power from “skills,” or apps, that are developed by third-party developers. They give it the power, via voice, to deliver a wide range of content on every topic under the sun.  Several already released “skills” give an idea of how this might work:

  • Ask My Buddy helps users in an emergency. In an emergency, it can send phone calls or text messages to up to five contacts. A user would say, “Alexa, ask my buddy Bob to send help” and Bob would get an alert to check in on his friend.
  • Linked thermostats can raise or lower the temperature a precise amount, and lights can also be turned on or off or adjusted for specific needs.
  • Marvee can keep seniors in touch w/ their families and lessen social isolation.
  • The Fitbit skill allows the user who also has a Fitbit to trace their physical activity, encouraging fitness.

Again looking to Boston for precedent, related apps include the Children’s Hospital and Kids’ MD ones from Children’s Hospital. Imagine how helpful it could be if the gerontology departments of hospitals provided similar “skills” for seniors!

Most important to making this service work would be to capitalize on the growing number of city-based open-data programs that release a variety of important real-time data bases which independent developers mash up to create “skills”  such as real-time transit apps.  The author was a consultant to the District of Columbia in 2008 when it began this data-based “smart city” approach with the Apps for Democracy contest, which has spawned similar projects worldwide since then.  When real-time city data is released, the result is almost magic: individuals and groups see different value in the same data, and develop new services that use it in a variety of ways at no expense to taxpayers.

The key to this half of the pilot programs would be creating a working relationship with local Meetups such as those already created in various cities for Alexa programmers, which would facilitate the relationship) to stage one or more high-visibility hackathons. Programmers from major public and social service institutions serving seniors, colleges and universities, and others with an interest in the subject could come together to create “skills” based on the local public data feeds, to serve seniors’ needs, such as:

  • health
  • nutrition
  • mobility
  • city services
  • overcoming social isolation (one might ask how a technological program could help with this need. The City of Barcelona, generally acknowledged as the world’s “smartest” city, is circulating an RFP right now with that goal and already has a “smart” program for seniors who need immediate help to call for it) .

“Skills” are proliferating at a dizzying rate, and ones developed for one city can be easily adapted for localized use elsewhere.

Such a project would have no direct costs, but the city and/or a non-profit might negotiate lower bulk-buying rates for the devices, especially the l0wer price ($59 list) Amazon Dot, similar to the contract between the Japan Post Group, IBM, and Apple to buy 5 million iPads and equip them with senior-friendly apps from IBM which the Post Group would then furnish to Japanese seniors. Conceivably, the Dots bought this way might come preloaded with the localized and senior-friendly “skills.” 

The second component of a prototype SmartAging city program would make the wide range of local real-time location-based data available by various cities usable by cities joininh the 100+ cities worldwide who have joined the “Things Network” that create free citywide data networks specifically for Internet of Things use.

The concept uses technology called LoRaWAN: low-cost (the 10 units used in Amsterdam, each with a signal range of about 6 miles, only cost $12,000 total — much cheaper ones will be released soon), and were deployed and operative in less than a month!  The cost and difficulty of linking an entire city has plummeted as more cities join, and the global project is inherently collaborative.

With Things Network, entire cities would be converted into Internet of Things laboratories, empowering anyone (city agencies, companies, educational institutions, non-profits, individuals) to experiment with offering new services that would use the no-cost data sharing network.  In cities that already host Things Networks,  availability of the networks has spawned a wide range of novel local services.  For example, in Dunblane, Scotland, the team is developing a ThingsNetwork- based alarming system for people with dementia.  Even better, as the rapid spread of citywide open data programs and resulting open source apps to capitalize on them has illustrated, a neat app or service created in one city could easily be copied and enhanced elsewhere — virtuous imitation!

The critical component of the prototype programs would be to hold one or more hackathons once the network was in place.  The same range of participants would be invited, and since the Things Network could also serve a wide range of other public/private uses for all age groups and demographics, more developers and subject matter experts might participate in the hackathon, increasing the chances of more robust and multi-purpose applications resulting.

These citywide networks could eventually become the heart of ambitious two-way services for seniors based on real-time data, similar to those in Bolsano, Italy. 

The Internet of Things and smart cities will become widespread soon simply because of lowering costs and greater versatility, whether this prototype project for seniors happens or not. The suggestions above would make sure that the IoT serves the public interest by harnessing IoT data to improve seniors’ health, reduce their social isolation, and make them more self-sufficient. It will reduce the burden on traditional government services to seniors while unlocking creative new services we can’t even visualize today to enhance the aging process.

comments: Comments Off on A Vision for Dynamic and Lower-Cost Aging in Cities Through “SmartAging” tags: , , , , , , ,

#IoT Sensor Breakthroughs When Lives Are On the Line!

Posted on 7th July 2017 in agriculture, data, defense, energy, Homeland Security, Internet of Things, M2M, maintenance, mobile, security, sensors, smart cities, US government

One of my unchanging principles is always to look to situations where there’s a lot at stake — especially human lives — for breakthroughs in difficult issues.

Exhibit A of this principle for the IoT is sensor design, where needing to frequently service or recharge critical sensors that detect battlefield conditions can put soldiers’ lives at stake (yes, as long-time readers know, this is particularly of interest to me because my Army officer son was wounded in Iraq).

FedTech reports encouraging research at DARPA on how to create sensors that have ultra-low power requirements, can lie dormant for long periods of time and yet are exquisitely sensitive to critical changes in conditions (such as vehicle or troop movements) that might put soldiers at risk in battlefield conditions.

The  N-ZERO (Near Zero RF and Power Operations)  program is a three-year initiative to create new, low-energy battlefield sensors, particularly for use at forward operating bases where conditions can change quickly and soldiers are constantly at risk — especially if they have to service the sensors:

“State-of-the-art military sensors rely on “active electronics” to detect vibration, light, sound or other signals for situational awareness and to inform tactical planning and action. That means the sensors constantly consume power, with much of that power spent processing what often turns out to be irrelevant data. This power consumption limits sensors’ useful lifetimes to a few weeks or months with even the best batteries and has slowed the development of new sensor technologies and capabilities. The chronic need to service or redeploy power-depleted sensors is not only costly and time-consuming but also increases warfighter exposure to danger.”

…. (the project has) the goal of developing the technological foundation for persistent, event-driven sensing capabilities in which the sensor can remain dormant, with near-zero power consumption, until awakened by an external trigger or stimulus. Examples of relevant stimuli are acoustic signatures of particular vehicle types or radio signatures of specific communications protocols. If successful, the program could extend the lifetime of remotely deployed communications and environmental sensors—also known as unattended ground sensors (UGS)—from weeks or months to years.”

A key goal is a 20-fold battery size reduction while still having the sensor last longer.

What cost-conscious pipeline operators, large ag business or “smart city” transportation director wouldn’t be interested in that kind of product as well?

According to Signal, the three-phase project is ahead of its targets. In the first part, which ended in December, the DARPA team created “zero-power receivers that can detect very weak signals — less than 70 decibel-milliwatt radio-frequency (RF) transmissions, a measure that is better than originally expected.” This is critical to the military (and would have huge benefits to business as well, since monitoring frequently must be 24/7 but reporting of background data  (vs. significant changes) would both deplete batteries while requiring processing of huge volumes of meaningless data). Accordingly, a key goal would be to create “… radio receivers that are continuously alert for friendly radio transmissions, but with near zero power consumption when transmissions are not present.” A target is  “exploitation of the energy in the signal signature itself to detect and discriminate the events of interest while rejecting noise and interference. This requires the development of passive or event-powered sensors and signal-processing circuitry. The successful development of these techniques and components could enable deployments of sensors that can remain “off” (that is, in a state that does not consume battery power), yet alert for detecting signatures of interest, resulting in greatly extended durations of operation.”

The “exploitation of .. energy in the signal signature itself sounds reminiscent of the University of Washington research I’ve reported in the past that would harness ambient back-scatter to allow battery-less wireless transmission, another key potential advance in IoT sensor networks.

The following phrases of N-ZERO will each take a year.

Let’s hope that the project is an overall success, and that the end products will also be commercialized. I’ve always felt sensor cost and power needs were potential IoT Achilles’ heels, so that would be a major boost!

comments: Comments Off on #IoT Sensor Breakthroughs When Lives Are On the Line! tags: , , , , ,

Hippo: IoT-based paradigm shift from passive to active insurance companies

Posted on 14th June 2017 in data, home automation, Internet of Things, management, paradigm shift, services, strategy

I’m a big advocate of incremental IoT strategies (check out my recent webinar with Mendix on this approach), for existing companies that want to test the waters first. However, I’m enough of a rabble-rouser to also applaud those who jump right in with paradigm-busting IoT (and big data) startups.

Enter, stage left, a nimble (LOL) new home insurance company: Hippo!

IMHO, Hippo’s important both in its own right and also as a harbinger of other startups that will exploit the IoT and big data to break with years of tradition in the insurance industry as a whole, no longer sitting passively to pay out claims when something bad happens, but seizing the initiative to reduce risk, which is what insurance started out to do.

After all, when a Mr. B. Franklin (I’ll tell you: plunk that guy down in 2017 and he’d create a start-up addressing an unmet need within a week!) and his fellow firefighters launched the Philadelphia Contributionship in 1752, one of the first things they did was to send out appraisers to determine the risk of a house burning and suggest ways to make it safer.

Left to right: Eyal Navon, CTO and cofounder; Assaf Wand, CEO cofounder of Hippo

In fact, there’s actually a term for this kind of web-based insurance, coined by McKinsey: “insuretec” (practicing what he preached, one of Hippo’s founders had been at McKinsey, and what intrigued the founders about insurance as a target was that it’s a huge industry, hasn’t really innovate for years, and didn’t focus on the customer experience.).

I talked recently to two key staffers, Head of Product Aviad Pinkovezky and Head of Marketing, Growth and Product Innovation Jason White.  They outlined a radically new strategy “with focused attention on loss reduction”:

  • sell directly to consumers instead of using agents
  • cut out legacy coverage leftovers, such as fur coats, silverware & stock certificates in a home safe) and instead cover laptops, water leaks, etc.
  • Leverage data to inform customers about appliances they own that might be more likely to cause problems, and communicate with them on a continuous basis about steps such as cleaning gutters that could reduce problems.

According to Pinkovezky, the current companies “are reactive, responding to something that takes place. Consumer-to-company interaction is non-continuous, with almost nothing between paying premiums and filing a claim.  Hippo wants to build must more of a continuous relationship, providing value added,” such as an IoT-based water-leak detection device that new customers receive.

At the same time, White said that the company is still somewhat limited in what if can do to reduce risk because so much of it isn’t really from factors such as theft (data speaks: he said thefts actually constitute little of claims) but from one, measured by frequency and amount of damage (according to their analysis) that’s beyond their control: weather. As I pointed out, that’s probably going to constitute more of a risk in the foreseeable future due to global warming.

Hippo also plans a high-tech, high-touch strategy, that would couple technnology with a human aspect that’s needed in a stressful situation such as a house fire or flood. According to Forbes:

“The company acknowledges that its customers rely on Hippo to protect their largest assets, and that insurance claims often derive from stressful experiences. In light of this, Hippo offers comprehensive, compassionate concierge services to help home owners find hotels when a home becomes unlivable, and to supervise repair contractors when damage occurs.”

While offering new services, the company has firm roots in the non-insuretech world, because its policies are owned and covered by Topa, which was founded more than 30 years ago.

Bottom line: if you’re casting about for an IoT-based startup opportunity, you’d do well to use the lens McKinsey applied to insurance: look for an industry that’s tradition-bound, and tends to react to change rather than initiate it (REMEMBER: a key element of the IoT paradigm shift is that, for the first time, we can piece “universal blindness” and really see inside things to gauge how they are working [or not] — the challenge is to capitalize on that new-found data). 

comments: Comments Off on Hippo: IoT-based paradigm shift from passive to active insurance companies tags: , , , , , , ,

ThingWorx Analytics Video: microcosm of why IoT is so transformative!

Posted on 8th May 2017 in circular company, collaboration, data, Internet of Things, M2M, maintenance, management, open data, sensors, strategy

I’ll speak at PTC’s LiveWorx lollapalooza later this month (ooh: act quickly and I can get you a $300 registration discount: use code EDUCATE300) on my IoT-based Circular Company meme, so I’ve been devouring everything I can about ThingWorx to prepare.

Came across a nifty 6:09 vid about one component of ThingWorx, its Analytics feature. It seems to me this video sez it all about both how you can both launch an incremental IoT strategy (a recent focus of mine, given my webinar with Mendix) that will begin to pay immediate benefits and can serve as the basis for more ambitious transformation later, especially because you’ll already have the analytical tools such as ThingWorx Analytics already installed.

What caught my eye was that Flowserve, the pump giant involved in this case, could retrofit existing pumps with retrofit sensors from National Instruments — crucial for two reasons:

  • you may have major investments in existing, durable machinery: hard to justify scrapping it just to take advantage of the IoT
  • relatively few high-end, high-cost machinery and devices have been redesigned from the ground up to incorporate IoT monitoring and operations.

Note the screen grab: each of these sensors takes 30,000 readings per second. How’s that for real-time data?  PTC refers to this as part of the “volume, velocity and variety challenge of data” with the IoT.

As a microcosm of the IoT’s benefits, this example shows how easy it is to use those massive amounts of data and how they can be used to improve understanding and performance.

There are three major components:

  • ThingWatcher:
    This is the most critical component, because it sifts through the incredible amount of data from the edge, learns what constitutes normal performance for that sensor (creating “pop-up learning flags”), and then monitors it future performance for anomalies and, as the sample video shows, delivers real-time alerts to users (without requiring human monitoring) so they can make adjustments and/or order repairs.  Finds anomalies from edge devices in real-time. Automatically observes and learns the normal state pattern for every device or sensor. It then monitors each for anomalies and delivers re- al-time alerts to end users.
  • ThingPredictor:
    For the all-important new function of predictive maintenance, two different types of ThingPredictor indicators pop up when if anomalies are detected, predicting how long it may be until failure, allowing plenty of time for less-costly, anticipatory repairs. Because the specific deviation is identified in advance, repair crews will have the needed part with them when needed, rather than having to make an additional trip back to pick up parts.

    If you ask for a standard predictive scoring you don’t specify which performance features to include and get a simple predictive score. However, you can specify several key features to evaluate and get a more detailed (and probably more helpful) answer. For example,  “if you indicate an important feature count of three, the causal scoring output will include the three most influential features for each record and the percentage weights of each feature’s influence on the score.”

  • ThingOptimizer:
    Finally, you can use “ThingOptimizer” to do some what-if calculations to decide which possible “levers,” as ThingWorx calls the key variables, could change the projections to either maximize a positive factor or minimize the negatives. “Prescriptive scoring results include both an original score (the score before any lever attributes are changed) and an optimized score (the score after optimal values are applied to the lever attributes). In addition, for each attribute identified in your data as a lever, original and optimal values are included in the prescriptive scoring results.” It sort of reminds me how the introduction of VisiCalc allowed users, for the first time, to play around with variables to see which would have the best results.
Best of all, as the video illustrates, ThingWorx Analytics would facilitate the kind of “Circular Company” I’ll address in my speech, because the exact same real-time data could simultaneously be used by operating personnel to fine tune operations and catch a problem in time for predictive maintenance, and by senior management to get an instant overview of how operations are going at all the installations. Same data, many uses.
Bottom line: a robust IoT platform could be the key to an incremental strategy to begin by improving daily operations and reducing maintenance problems, and also be the underpinning for more radical transformation as your IoT strategy becomes more advanced!  See you at LiveWorx!
comments: Comments Off on ThingWorx Analytics Video: microcosm of why IoT is so transformative! tags: , , , , , , , ,

Creating Your Incremental IoT Strategy Webinar Tomorrow!

Posted on 1st May 2017 in circular company, data, design

creating your IoT strategy webinar

Hope you’ll join me and Mendix  (which, BTW,  Gartner just tabbed as a platform as service [Paas] “Magic Quadrant” leader for its low-code tools for rapid app development!), for a 10 AM (EDT) webinar Tuesday the 2nd on creating incremental IoT strategies (register here).

In a way, this is an update of the e-book I wrote for SAP several years ago, Mastering the Internet of Things Revolution, in which I also outlined an incremental strategy for testing the IoT waters and then building on those early experiments for more comprehensive change.

That’s important if your company doesn’t have the resources for a total IoT makeover, or if you’re a little in doubt about how the IoT would benefit you.

While I do give a teaser for my IoT-data based “Circular Company” paradigm shift, the webinar is otherwise focused on how incremental IoT projects allow you to build unprecedented (and previously impossible, due to our inability to “see” what was happening inside of things) precision in every aspect of your operations:

Along the way I’ll show how the Mendix platform can play a role, — consistent with the democratizing data meme I’ve pushed since my Data Dynamite book — of empowering everyone, not just programmers, to quickly create enterprise low-code apps to capitalize on the incredible data the IoT yields.

Please join us.

 

comments: Comments Off on Creating Your Incremental IoT Strategy Webinar Tomorrow! tags: , , , , ,

Servitization With IoT: Weird Biz-Speak, But Sound Strategy

Posted on 21st April 2017 in agriculture, automotive, circular economy, data, Essential Truths, Internet of Things, M2M, maintenance, marketing, paradigm shift, sensors, services, strategy

I love it when manufacturers stop selling things — and their revenues soar!

That’s one of the things I’ll cover on May 2nd  in”Define Your Breakout IoT” strategy, (sign-up) a webinar I’m doing with Mendix. I’ll outline an incremental approach to the IoT in which you can make some early, tentative steps (such as implementing Augury’s hand-held vibration sensor as a way to start predictive maintenance) and then, as you gain experience and increase savings and efficiency, plow the savings back into more dramatic transformation.

One example of the latter that I’ll detail in the webinar is one of my four “Essential Truths” of the IoT: rethink products. By that I meant not only reinventing products to be smart (especially by building in sensors so they can report their real-time status 24/7), but, having done that, exploring new ways to market them.  Or, as one graphic I’ll use in the presentation puts it, in mangled biz-speak, “servitization.”

              Hortilux bulbs

Most of the examples I’ve written about in that regard have been from major businesses, such as GE and Rolls-Royce jet turbines, that are now leased as services (with the price determined by thrust generated), but Mendix has a smaller, niche client that also successfully made the conversion: Hortilux, a manufacturer of grow lights for greenhouses.

The Hortilux decided to differentiate itself in an increasingly competitive grow light market by evolving from simply selling bulbs to instead providing a comprehensive continuing service that helps its customers optimize availability and lifetime of grow light systems, while cut energy cost.     

Using Mendix tools, they created Hortisensehttp://www.hortidaily.com/article/31774/Hortilux-launches-Hortisense-software-suite, a digital platform that monitors and safeguards various grow light processes in the greenhouse using sensors and PLCs. Software applications interpret the data and present valuable information to the grower anytime, anywhere, and on any device.

With Mendix, Hortilux created an application to collect sensor data on light, temperature, soil, weather and more. Now users can optimize plants’ photosynthesis, energy consumption, and greenhouse maintenance. Most ambitiously, it provides comprehensive “crop yield management:” 

  • Digital cultivation schedule
  • Light strategies based on plant physiology and life cycle
  • Automatic light adjustment based on predictive analytics (e.g. weather forecast, energy prices, produce prices)

The app even allows predictive maintenance, predicting bulbs’ life expectancy and notifying maintenance to replace them in time to avoid disruptions in operations.

In the days when we suffered from what I call “Collective Blindness,” when we lacked the tools to “see” inside products to m0nitor and perhaps fix them based on real-time operating data, it made sense to sell products and provide hit-or-miss maintenance when they broke down.

Now that we can monitor them 24/7 and get early enough warning to instead provide predictive maintenance, it makes equal sense to switching to marketing them as services, with mutual benefits including:

  • increased customer satisfaction because of less down-time
  • new revenues from selling customers services based on availability of the real-time data, which in turn allows them more operating precision
  • increased customer loyalty, because the customer is less likely to actually go on the open market and buy a competing product
  • the opportunity to improve operations through software upgrades to the product.

Servitization: ugly word, but smart strategy. Hope you’ll join us on the 2nd!

comments: Comments Off on Servitization With IoT: Weird Biz-Speak, But Sound Strategy tags: , , , , , ,

Updating my “SmartAging” device design criteria

Posted on 15th March 2017 in aging, health, home automation, Internet of Things, m-health, mobile, paradigm shift, Quantified Self, seniors, SmartAging, wearables

Could seniors be the ideal test group for user-friendly consumer IoT devices?

Two years ago I created a series of criteria by which to evaluate IoT devices that seniors might use (N.B., I didn’t really focus on ones specifically designed for seniors, because I have an admitted bias against devices with huge buttons or that look like mid-century period tube radios — it’s been my experience that seniors aren’t crying out to be labeled as “different.”) to improve their quality of life.

The particular emphasis was on what I called “SmartAging,” which synthesizes two aspects of the IoT:

  • Quantified Self health devices to keep seniors healthier longer and to become partners with their doctors rather than passive recipients of care, and
  • smart home devices to make it easier to run their homes, so that seniors could remain on their own as long as possible rather than entering some drab, sterile assisted-living facility (again, my bias showing…).

A lot has happened since I compiled the list. The changes have solidified my conviction that seniors, especially the less technologically minded, might be the acid test of consumer IoT user friendliness because they can’t be expected to work as hard at mastering devices, they don’t have the automatic openness of digital natives, and encounter differing degrees of reduced agility, etc. 

Also, given the current political climate, it makes sense to try to improve seniors’ lives as much as possible without requiring costly public services that are in jeopardy (I am trying to be civil here, OK?).

The most dramatic of these developments is the amazing success of Amazon’s voice-activated Echo.  I’ve praised it before as an ideal device for seniors, partially because voice is such a natural input for anyone, and particularly because it means that the tech-averse don’t have to learn about interfaces or programs, just speak! Even better, as the variety of “skills” increases, the Echo really is becoming a unified SmartAging hub: I can now control my Sensi smart thermostats and the “Ask My Buddy” skill can even call for assistance, so it works for both halves of SmartAging.  Although I haven’t tested it, I assume much of this also holds true for the Google Home.

There’s an increasing variety of other new Quantified Self devices, some of which are specifically focused on seniors, such as the GreatCall Jitterbug Smart phone, which comes with a simplified, over-size home page featuring “brain games” a la Lumosity, and an Urgent Response system (all of these features are available on an iPhone and, I assume, on Android, but must be set in Settings rather than being the default settings).

In addition, on the personal level, I convinced my Apple Store (disclaimer: I’m at the bottom of the food chain with Apple, not privy to any policies or devices under consideration, so this is just my opinion) to let me start bi-weekly classes at the local senior center on how to use Apple devices, especially the iPad. I continue to work with a lot of seniors who come into the store who are often leery of tech products.

Silver Medal!

Most directly, last month’s companywide Apple Wellness Challenge was life-changing for me.  This year the friendly competition focused on the Apple Watch (important, since a watch is a familiar form-factor to geezers). After wasting three days trying to find the app, I really got into the event because we could share results with friends to encourage (or shame, LOL) them — that really motivated me.  Bottom line: I managed to win a Silver Medal, Apple featured my experience on the event website, and, most important, I made lasting changes to my fitness regimen that I’ve sustained since then, now exercising almost an entire hour a day. I couldn’t help think afterward that the program really did show that user-friendly technology can improve seniors’ lives.

Sooo, with a few more years to think about them and more progress in devices themselves, (as well as increased sensitivity to issues such as privacy and security) here are my amended criteria for evaluating products and services for seniors. As I mentioned the first time, Erich Jacobs of OnKöl assisted with the specs):

Ease of Use

  1. Does it give you a choice of ways to interact, such as voice, text or email? Voice in particular is good for seniors who don’t want to learn about technology, just use it.
  2. Is it easy for you to program, or — if you them give your permission — does it allow someone else to do it remotely?
  3. Does it have either a large display and controls or the option to configure them through settings?
  4. Is it intuitive?
  5. Does it require hard-wired, professional installation?
  6. Is it flexible: can it be adjusted? Is it single purpose, or does it allow other devices to plug in and create synergies? Can it be a true hub for all your IoT devices?
  7. Does it complicate your life, or simplify it?
  8. Do any components require regular charging, or battery replacement?

Privacy, Security, and Control

  1. Is storage local vs. cloud or company’s servers? Is data encrypted? Anonymized?
  2. Do you feel creepy using it?
  3. Is it password-protected?
  4. Is security “baked in” or an afterthought?
  5. Can you control how, when, and where information is shared?
  6. If it is designed to allow remote monitoring by family or caregivers, can you control access by them?
  7. Will it work when the power goes out?

Affordability

  1. Are there monthly fees? If so, low or high? Long term contract required?
  2. Is there major upfront cost? If so, is that offset by its versatility and/or the contrast to getting the same services from a company?
  3. Does full functioning require accessories?

Design/UX

  1. Is it stylish, or does the design” shout” that it’s for seniors? Is it “Medical” looking?
  2. Is the operation or design babyish?
  3. Would younger people use it?
  4. Is it sturdy?
  5. Does it have “loveability” (i.e., connect with the user emotionally)? (This term was coined by David Rose in Enchanted Objects, and refers to products that are adorable or otherwise bond with the user.)

Architecture

  1. Inbound
    1. Does it support multiple protocols (eg. Bluetooth, BluetoothLE, WiFi, etc)
    2. Is the architecture open or closed?
  2. Outbound
    1. Does it support multiple protocols (eg. WiFi, Ethernet, CDMA, GSM, etc)
    2. Data path (cloud, direct, etc)
  3. Remote configuration capability (i.e., by adult child)? If so, can the user control amount of outside access?

Features and Functions

  1. Reminders
    1. Passive, acknowledge only
    2. Active dispensing (of meds)
  2. Home Monitoring
    1. Motion/Passive Activity Monitoring
    2. Environmental Alarms (Smoke, CO, Water, Temp)
    3. Intrusion Alarms (Window etc)
    4. Facilities/Infrastructure (Thermostat)
  3. Health Monitoring
    1. Vitals Collection
    2. Wearables Activity Monitoring
    3. Behavioral/Status Polling (How are you feeling today?)
    4. Behavioral Self-improvement
  4. Communications Monitoring
    1. Landline/Caller ID
      1. Identify scammers
    2. eMail and computer use
      1. Identify scammers
    3. Mobile phone use
  5. Fixed Personal Emergency Response System (PERS)
  6. Mobile Personal Emergency Response System (PERS)
  7. Fixed Fall Detection/Prediction
  8. Mobile Fall Detection/Prediction
  9. Telehealth (Video)
  10. New and Innovative Features

If you’re thinking about developing an IoT product and/or service for seniors I hope you’ll consider the SmartAging concept, and that these criteria will be helpful. If you’re looking for consulting services on design and/or implementation, get in touch!

comments: Comments Off on Updating my “SmartAging” device design criteria tags: , , , , , , , , ,

Sound’s emerging IoT role

Posted on 7th March 2017 in automotive, data, Internet of Things, maintenance, manufacturing, sensors

Could sound be a critical IoT tool?

I’d fixated in the past on a metaphor I called “Collective Blindness,” as a way to explain how difficult it used to be to get accurate, real-time data about how a whole range of things, from tractors to your body, were actually working (or not) because we had no way to penetrate the surface of these objects as they were used. As a result, we created some not-so-great work-arounds to cope with this lack of information.

Then along came the IoT, and no more collective blindness!

Now I’m belatedly learning about some exciting efforts to use another sense, sound, for the IoT.  Most prominent, of course, is Amazon’s Alexa and her buddies (BTW, when I ask Siri if she knows Alexa, her response was an elusive “this is about you, not me,” LOL), but I’ve found a variety of start-ups pursuing quite different aspects of sound. They nicely illustrate the variety of ways sound might be used.

technician using Auguscope to detect   sound irregularities in machinery

First is Augury.

What I particularly love about their device and accompanying smartphone app it is that they are just about the lowest-cost, easiest-to-use, rapid payback industrial IoT devices I can think of.

That makes them a great choice to begin an incremental approach to the IoT, testing the waters by some measures that can be implemented quickly, pay rapid bottom-line benefits and therefore may lure skeptical senior management who might then be willing to then try bolder measures   (this incremental approach was what I outlined in my Managing the Internet of Things Revolution e-guide for SAP, and I’ll be doing a webinar on the approach in April with Mendix, which makes a nifty no-code, low-code tool).

Instead of requiring built-in sensors, an Auguscope is a hand-held device that plant personnel can carry anywhere in the building it’s needed to analyze how the HVAC system is working. A magnetic sensor temporarily attaches to the machine and the data flows from the Auguscope to the cloud where it is analyzed to see if the sound is deviating from pre-recorded normal sounds, indicating maintenance is needed. Consistent with other IoT products that are marketed as services instead of sold, it uses a “Diagnostics as a Service” model, so there are no up-front costs and customers pay as they go. The company hopes that the technology will eventually be built into household appliances such as washers and dryers.

Presenso is the second company using sound to enable predictive maintenance.  It is sophisticated cloud-based software that takes data from a wide range of already-installed sensors and interprets any kind of data: sound, temperature, voltage, etc.  It builds a model of the machine’s normal operating data and then creates visualizations when the data varies from the norm. Presenso’s power comes from combining artificial intelligence and big data.

Finally, and most creative is Chirp (hmm: Chrome wouldn’t let me enter their site, which it said was insecure. Here’s the URL:www.chirp.io/ — try at your own risk…) , a UK company that transmits data using audio clips that really sound like chirps. It’s amazing!  Check out this video of an app in India that uses sound to pay fares on the country’s version of Uber:


Another Chirp app is a godsend to all who forget Wi-Fi passwords: your phone “chirps” a secure access code, allowing you to join the network automatically.   The company has released iOS and Android versions.  As VentureBeat reported:

“Each chirp lasts a couple of seconds, and the receiving device “listens” for a handful of notes played quickly in a certain order, in a certain range, and at a certain speed. While there are other easy ways of sharing files and data in real-time, such as Bluetooth, Chirp doesn’t require devices to pair in advance, there is no need to set up an account, and it’s ultimately a much quicker way of sharing files.

“That said, with Chirp, the file itself isn’t sent peer-to-peer, and the data doesn’t actually travel directly via audio. Chirp merely decodes and encodes the file, with the associated sound serving as the delivery mechanism. A link is generated for the recipient(s) to access it on Chirp’s servers, but the process from sending to receiving is seamless and near-instant.”

In terms of IoT applications, it could also connect with physical objects (hmm: retailing uses??). The Chirp platform is so cool that I suspect it will be a global hit (the company says it’s already used in 90 countries).

So, I’ve had my senses opened: from now on, I’ll add voice and sound in general to the list of cool IoT attributes.  Because voice and sound are so ubiquitous, they really meet the late Mark Weiser’s test:  “the most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.” What could be more woven into the fabric of everyday life than sound — and, potentially, more valuable?

BTW: let me put in a plug for another IoT voice product. During the past two months, I recorded 7 hours of my voice speaking a very strange mishmash of sentences drawn from, among others, Little Women, Jack London’s Call of the Wild, The Wizard of Oz, and The Velveteen Rabbit (I worried about the she-wolf sneaking up on Meg, LOL….). Using the algorithms developed for Alexa, the Vocal ID team will slice and dice my voice and create a natural sounding one for someone who cannot speak due to a birth defect or disease.  I hope you’ll join me in volunteering for this wonderful program.

comments: Comments Off on Sound’s emerging IoT role tags: , , , , ,

Surprising Benefits of Combining IoT and Blockchain (they go beyond economic ones!)

Posted on 21st February 2017 in agriculture, circular company, circular economy, data, environmental, Essential Truths, government, Internet of Things, management, marketing, open data, paradigm shift, privacy, security, strategy, supply chain

One final effort to work this blockchain obsession out of my system so I can get on to some exciting other IoT news!

I couldn’t resist summarizing for you the key points in”Blockchain: the solution for transparency in product supply chains,” a white paper from Project Provenance Ltd., a London-based collective  (“Our common goal is to deliver meaningful change to commerce through open and accessible information about products and supply chains.”).

If you’ve followed any of the controversies over products such as “blood diamonds” or fish caught by Asian slaves & sold by US supermarkets, you know supply chains are not only an economic issue but also sometimes a vital social (and sometimes environmental) one. As the white paper warns:

“The choices we make in the marketplace determine which business practices thrive. From a diamond in a mine to a tree in a forest, it is the deepest darkest ends of supply chains that damage so much of the planet and its livelihood.”

Yikes!

Now blockchain can make doing the right thing easier and more profitable:

“Provenance enables every physical product to come with a digital ‘passport’ that proves authenticity (Is this product what it claims to be?) and origin (Where does this product come from?), creating an auditable record of the journey behind all physical products. The potential benefits for businesses, as well as for society and the environment, are hard to overstate: preventing the selling of fake goods, as well as the problem of ‘double spending’ of certifications present in current systems. The Decentralized Application (Dapp) proposed in this paper is still in development and we welcome businesses and standards organizations to join our consortium and collaborate on this new approach to understanding our material world.”

I also love Provenance’s work with blockchain because it demonstrates one of my IoT “Essential Truths,” namely, that we must share data rather than hoard it.  The exact same real-time data that can help streamline the supply chain to get fish to our stores quicker and with less waste can also mean that the people catching it are treated fairly. How cool is that?  Or, as Benjamin Herzberg, Program Lead, Private Sector Engagement for Good Governance at the World Bank Institute puts it in the quote that begins the paper, Now, in the hyper-connected and ever-evolving world, transparency is the new power.

While I won’t summarize the entire paper, I do recommend that you so, especially if blockchain is still new to you, because it gives a very detailed explanation of each blockchain component.

Instead, let’s jump in with the economic benefits of a blockchain and IoT-enabled supply chain, since most companies won’t consider it, no matter what the social benefits, if it doesn’t help the bottom line. The list is long, and impressive:

  • “Interoperable: A modular, interoperable platform that eliminates the possibility of double spending
  • Auditable: An auditable record that can be inspected and used by companies, standards organizations, regulators, and customers alike
  • Cost-efficient:  A solution to drastically reduce costs by eliminating the need for ‘handling companies’ to be audited
  • Real-time and agile:  A fast and highly accessible sign-up means quick deployment
  • Public: The openness of the platform enables innovation and could achieve bottom-up transparency in supply chains instead of burdensome top-down audits
  • Guaranteed continuity:  The elimination of any central operator ensures inclusiveness and longevity” (my emphasis)

Applying it to a specific need, such as documenting that a food that claims to be organic really is, blockchain is much more efficient and economical than cumbersome current systems, which usually rely on some third party monitoring and observing the process.  As I’ve mentioned before, the exquisite paradox of blockchain-based systems is that they are secure and trustworthy specifically because no one individual or program controls them: it’s done through a distributed system where all the players may, in fact, distrust each other:

“The blockchain removes the need for a trusted central organization that operates and maintains this system. Using blockchains as a shared and secure platform, we are able to see not only the final state (which mimics the real world in assigning the materials for a given product under the ownership of the final customer), but crucially, we are able to overcome the weaknesses of current systems by allowing one to securely audit all transactions that brought this state of being into effect; i.e., to inspect the uninterrupted chain of custody from the raw materials to the end sale.

“The blockchain also gives us an unprecedented level of certainty over the fidelity of the information. We can be sure that all transfers of ownership were explicitly authorized by their relevant controllers without having to trust the behavior or competence of an incumbent processor. Interested parties may also audit the production and manufacturing avatars and verify that their “on-chain” persona accurately reflects reality.”

The white paper concludes by also citing an additional benefit that I’ve mentioned before: facilitating the switch to an environmentally-sound “circular economy,” which requires not only tracking the creation of things, but also their usage, trying to keep them out of landfills. “The system proposed in this paper would not only allow the creation (including all materials, grades, processes etc) and lifecycle (use, maintenance etc) to be logged on the blockchain, but this would also make it easy to access this information when products are returned to be assessed and remanufactured into a new item.”

Please do read the whole report, and think how the economic benefits of applying blockchain-enabled IoT practices to your supply chain can also warm your heart.

 

comments: Comments Off on Surprising Benefits of Combining IoT and Blockchain (they go beyond economic ones!) tags: , , , , , , ,
« Previous Next »
http://www.stephensonstrategies.com/">Stephenson blogs on Internet of Things Internet of Things strategy, breakthroughs and management