Reference TypeConference Proceedings
Citation KeyBatistadaCunhaSanValMagTei:2020:StImDo
Author1 Batista da Cunha, Kelvin
2 dos Santos Brito, Caio José
3 Valença da Rocha Martins Albuquerque, Lucas
4 Magalhães Simões, Francisco Paulo
5 Teichrieb, Veronica
Affiliation1 Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
2 Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
3 Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
4 Curso Técnico em Informática para Internet, Instituto Federal de Pernambuco, Campus Belo Jardim
5 Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
TitleA Study on the Impact of Domain Randomization for Monocular Deep 6DoF Pose Estimation
Conference NameConference on Graphics, Patterns and Images, 33 (SIBGRAPI)
EditorMusse, Soraia Raupp
Cesar Junior, Roberto Marcondes
Pelechano, Nuria
Wang, Zhangyang (Atlas)
Book TitleProceedings
DateNov. 7-10, 2020
Publisher CityLos Alamitos
PublisherIEEE Computer Society
Conference LocationVirtual
KeywordsPose Estimation, Deep Learning, Domain Randomization.
AbstractIn this work, we apply domain randomization to synthetic images and train deep 6DoF monocular RGB pose estimation models to work on a real object. We compare 19 models trained with different combinations of synthetic and real data (fully synthetic, fully real, initially synthetic and supplemented with real, and a real-synthetic randomized mix). By gradually decreasing the amount of real data used, we show it is possible for deep 6DoF detection to obtain superior results while using less real data (which is harder to obtain) and suggest the best approach to train a model with synthetic data. Our method is validated using a textureless 3D printed object, as the textureless category is a challenging, common open problem in itself. A real and a synthetic dataset generated for this work, totalling over 24,800 annotated frames, are also made public. We also show that synthetic, randomized data can help generalize a model by training it to handle challenges such as illumination changes and fast motion. Finally, we also evaluate how a model trained for one camera sensor works with a different one, and show that synthetic simulations of real cameras can help overcoming this challenge.
Tertiary TypeFull Paper
Size9047 KiB
Number of Files1
Target File108.pdf
Last Update2020:
Metadata Last Update2020: {D 2020}
Document Stagecompleted
Is the master or a copy?is the master
e-Mail (login)
Content TypeExternal Contribution
Document Stagenot transferred
source Directory Contentthere are no files
agreement Directory Content
agreement.html 30/09/2020 13:45 1.2 KiB 
Empty Fieldsaccessionnumber archivingpolicy archivist area callnumber copyholder copyright creatorhistory descriptionlevel dissemination doi edition electronicmailaddress group holdercode isbn issn label lineage mark nextedition nexthigherunit notes numberofvolumes orcid organization pages parameterlist parentrepositories previousedition previouslowerunit progress project readergroup readpermission resumeid rightsholder secondarydate secondarykey secondarymark secondarytype serieseditor session shorttitle sponsor subject tertiarymark type url versiontype volume
Access Date2020, Oct. 24