Leveraging transfer learning for multi-label attribute prediction in fashion images, using deep learning
About Babyshop Group
E-commerce is at the heart of Babyshop Group where premium childrens’ fashion is retailed on a multitude of websites (eg. lekmer.se, babyshop.se, alexandalexa.se). Babyshop Group has had continuous growth in the past years, currently selling and shipping internationally with a revenue of more than 1.5 billion SEK. In order to sustain such growth, Babyshop Group will continue to work in a data-driven environment, which you hopefully can be a part of! We at Babyshop work with machine learning (ML) on a daily basis, whether it being exploratory data analysis and modelling in a Jupyter Notebook or building ML-pipelines integrating cloud solutions. If this is something that you want to develop within and you find the thesis proposal interesting, apply! By the way, at our five story office in Karlaplan, you will find lots of tasty coffee, tea, and inspiring individuals.
At Babyshop Group, there exist tens of thousands of images of children’s apparel. Currently, new items are labeled by hand, where each item has multiple attributes, eg. color, category, pattern, neckline, and style, etc. Since the workload of this manual task is immense, a need for a support system is high. In literature, a multitude of previous work has been done in regards to multi-label attribute prediction on fashion clothing, most notably DeepFashion and iMaterialist Fashion. Here, deep learning models have been trained on hundreds of thousands of labeled images to predict corresponding attributes, which has proven highly successful. However, almost all of these images are of adult fashion, with very little emphasis on childrens’ fashion.
Recently, transfer learning has proved very successful in multiple areas, most prominently in regards to object-detection in images, using YoloV3, as well as natural language processing using BERT and GPT. Because of this, ML-practitioners with access to limited sets of labeled data can successfully leverage these transfer learning frameworks that are trained on immense datasets.
The question then arises, is it possible to combine the pre-trained models from previously mentioned multi-label attribution prediction models that are trained on almost exclusively adults’ fashion, together with the learnings from transfer-learning frameworks - in order to successfully perform multi-label attribution prediction on childrens’ fashion?
For a good fit we believe it to be preferable if you have the following qualifications:
What we offer
Starting, early January till mid-June
How to apply: You can apply both individually and as pairs, but if you apply as a pair, please attach Resumes from both candidates, as well as a jointly written Cover Letter in the application form below.
Last application date is 30/11, but please note that continuous selection is carried out
Contact: For questions please contact Marcus Svensson, Data Scientist at Babyshop Group firstname.lastname@example.org