Try our conversational search powered by Generative AI!

Allan Thraen
May 19, 2017
  3818
(5 votes)

New add-on in the nuget feed: Enrich your image assets with Azure Cognitive Services.

Back in November as Ascend Nordic, I demoed an early version of this functionality. It was later improved and shown at the opening keynote of Ascend USA. I received quite a lot of requests after that to make it publicly available - and now (I admit a bit late, Jeroen even beat me to it) I'm now sharing it as a nuget package on the Episerver feed - as well as putting my code on GitHub.

Basically, this is how it works:

1) Install the nuget package on your Episerver site. (Episerver.Labs.Cognitive). Note that this is an experimental package and not supported in any way!

2) Add the access key to your appSettings in web.config (details are included in a readme).

And start adding the properties you want to your image model and attach attributes to them to describe what kind of cognitive content you want them populated with!

For instance, to add a descriptive text to your image (can be useful for indexing with Episerver Find or Vulcan) just add this attribute:

[Vision(VisionType =VisionTypes.Description)]
public virtual string Description { get; set; }

To index text recognized in the image add:

[Vision(VisionType=VisionTypes.Text)]
public virtual string TextRecognized { get; set; }

Or, one of my favorite features - Get a smart thumbnail (where the interesting parts of the image are in focus):

[ScaffoldColumn(false)]
[SmartThumbnail(100,100)]
public virtual Blob SmartThumbnail{ get; set; }

You can of course also extract a list of the age and gender of all people in the image like this:

[Vision(VisionType = VisionTypes.Faces)]
[BackingType(typeof(PropertyStringList))]
[Display(Order = 305)]
[UIHint(Global.SiteUIHints.Strings)]
public virtual string[] Faces { get; set; }

and much, much more.

Enjoy!

May 19, 2017

Comments

Please login to comment.
Latest blogs
Optimizely and the never-ending story of the missing globe!

I've worked with Optimizely CMS for 14 years, and there are two things I'm obsessed with: Link validation and the globe that keeps disappearing on...

Tomas Hensrud Gulla | Apr 18, 2024 | Syndicated blog

Visitor Groups Usage Report For Optimizely CMS 12

This add-on offers detailed information on how visitor groups are used and how effective they are within Optimizely CMS. Editors can monitor and...

Adnan Zameer | Apr 18, 2024 | Syndicated blog

Azure AI Language – Abstractive Summarisation in Optimizely CMS

In this article, I show how the abstraction summarisation feature provided by the Azure AI Language platform, can be used within Optimizely CMS to...

Anil Patel | Apr 18, 2024 | Syndicated blog

Fix your Search & Navigation (Find) indexing job, please

Once upon a time, a colleague asked me to look into a customer database with weird spikes in database log usage. (You might start to wonder why I a...

Quan Mai | Apr 17, 2024 | Syndicated blog

The A/A Test: What You Need to Know

Sure, we all know what an A/B test can do. But what is an A/A test? How is it different? With an A/B test, we know that we can take a webpage (our...

Lindsey Rogers | Apr 15, 2024

.Net Core Timezone ID's Windows vs Linux

Hey all, First post here and I would like to talk about Timezone ID's and How Windows and Linux systems use different IDs. We currently run a .NET...

sheider | Apr 15, 2024