- Joined
- Oct 16, 2018
- Messages
- 213
I have a story to tell you....
When we started collecting data for our new push notifications spy tool, we saw some adult NSFW creative images in our feed. We did not want to show these images by default to our users because they may be accessing this site from public areas or in presence of their kids etc.
So we decided to create a pornographic/adult filter which would blur all the adult images and user can see the image only if he/she clicked on it. At that point my impression was AI/Machine-Learning algorithms should be pretty well advanced for automated detection.
We made a decision to sign up for Google's Vision API which is a paid service. After all, they should have the biggest collection of representative images for training their model.
After running hundreds of thousands of images through their API. My overall conclusion was.....
MEH.
There are way too many false positives i.e. images where the person is scantily clothed like bikinis or short skirts but there is no nudity at all.
But more worrisome is the fact that there are significant number of false negatives.
Sometimes blatant nudity is not recognized
Pictures that represent sexual organs is almost a complete failure.
When we started collecting data for our new push notifications spy tool, we saw some adult NSFW creative images in our feed. We did not want to show these images by default to our users because they may be accessing this site from public areas or in presence of their kids etc.
So we decided to create a pornographic/adult filter which would blur all the adult images and user can see the image only if he/she clicked on it. At that point my impression was AI/Machine-Learning algorithms should be pretty well advanced for automated detection.
We made a decision to sign up for Google's Vision API which is a paid service. After all, they should have the biggest collection of representative images for training their model.
After running hundreds of thousands of images through their API. My overall conclusion was.....
MEH.
There are way too many false positives i.e. images where the person is scantily clothed like bikinis or short skirts but there is no nudity at all.
But more worrisome is the fact that there are significant number of false negatives.
Sometimes blatant nudity is not recognized
Pictures that represent sexual organs is almost a complete failure.
