| 1. Identity statement | ||||
| Reference Type | Conference Paper (Conference Proceedings) | |||
| Site | sibgrapi.sid.inpe.br | |||
| Holder Code | ibi 8JMKD3MGPEW34M/46T9EHH | |||
| Identifier | 8JMKD3MGPEW34M/43BCFTS | |||
| Repository | sid.inpe.br/sibgrapi/2020/09.29.21.31 | |||
| Last Update | 2020:09.29.21.31.15 (UTC) administrator | |||
| Metadata Repository | sid.inpe.br/sibgrapi/2020/09.29.21.31.15 | |||
| Metadata Last Update | 2022:06.14.00.00.12 (UTC) administrator | |||
| DOI | 10.1109/SIBGRAPI51738.2020.00044 | |||
| Citation Key | MagalhăesSilGomMarSil:2020:EvEmWi | |||
| Title | Evaluating the Emergence of Winning Tickets by Structured Pruning of Convolutional Networks  | |||
| Format | On-line | |||
| Year | 2020 | |||
| Access Date | 2024, Oct. 15 | |||
| Number of Files | 1 | |||
| Size | 182 KiB | |||
| 2. Context | ||||
| Author | 1 Magalhăes, Whendell Feijó 2 Silva, Jeferson Ferreira da 3 Gomes, Herman Martins 4 Marinho, Leandro Balby 5 Silveira, Plínio | |||
| Affiliation | 1 Federal University of Campina Grande 2 Federal University of Campina Grande 3 Federal University of Campina Grande 4 Federal University of Campina Grande 5 Hewlett Packard Enterprise, Brazil | |||
| Editor | Musse, Soraia Raupp Cesar Junior, Roberto Marcondes Pelechano, Nuria Wang, Zhangyang (Atlas) | |||
| e-Mail Address | whendell@copin.ufcg.edu.br | |||
| Conference Name | Conference on Graphics, Patterns and Images, 33 (SIBGRAPI) | |||
| Conference Location | Porto de Galinhas (virtual) | |||
| Date | 7-10 Nov. 2020 | |||
| Publisher | IEEE Computer Society | |||
| Publisher City | Los Alamitos | |||
| Book Title | Proceedings | |||
| Tertiary Type | Full Paper | |||
| History (UTC) | 2020-09-29 21:31:15 :: whendell@copin.ufcg.edu.br -> administrator :: 2022-06-14 00:00:12 :: administrator -> whendell@copin.ufcg.edu.br :: 2020 | |||
| 3. Content and structure | ||||
| Is the master or a copy? | is the master | |||
| Content Stage | completed | |||
| Transferable | 1 | |||
| Version Type | finaldraft | |||
| Keywords | neural network compression structured pruning winning tickets weight rewinding learning rate rewinding | |||
| Abstract | The recently introduced Lottery Ticket Hypothesis has created a new investigation front in neural network pruning. The hypothesis states that it is possible to find subnetworks with high generalization capabilities (winning tickets) from an over-parameterized neural network. One step of the algorithm implementing the hypothesis requires resetting the weights of the pruned network to their initial random values. More recent variations of this step may involve: (i) resetting the weights to the values they had at an early epoch of the unpruned network training, or (ii) keeping the final training weights and resetting only the learning rate schedule. Despite some studies have investigated the above variations, mostly with unstructured pruning, we do not know of existing evaluations focusing on structured pruning regarding local and global pruning variations. In this context, this paper presents novel empirical evidence that it is possible to obtain winning tickets when performing structured pruning of convolutional neural networks. We setup an experiment using the VGG-16 network trained on the CIFAR-10 dataset and compared networks (pruned at different compression levels) got by weight rewinding and learning rate rewinding methods, under local and global pruning regimes. We use the unpruned network as baseline and also compare the resulting pruned networks with their versions trained with randomly initialized weights. Overall, local pruning failed to find winning tickets for both rewinding methods. When using global pruning, weight rewinding produced a few winning tickets (limited to low pruning levels only) and performed nearly the same or worse compared to random initialization. Learning rate rewinding, under global pruning, produced the best results, since it has found winning tickets at most pruning levels and outperformed the baseline. | |||
| Arrangement 1 | urlib.net > SDLA > Fonds > SIBGRAPI 2020 > Evaluating the Emergence... | |||
| Arrangement 2 | urlib.net > SDLA > Fonds > Full Index > Evaluating the Emergence... | |||
| doc Directory Content | access | |||
| source Directory Content | there are no files | |||
| agreement Directory Content |
| |||
| 4. Conditions of access and use | ||||
| data URL | http://urlib.net/ibi/8JMKD3MGPEW34M/43BCFTS | |||
| zipped data URL | http://urlib.net/zip/8JMKD3MGPEW34M/43BCFTS | |||
| Language | en | |||
| Target File | 133.pdf | |||
| User Group | whendell@copin.ufcg.edu.br | |||
| Visibility | shown | |||
| Update Permission | not transferred | |||
| 5. Allied materials | ||||
| Mirror Repository | sid.inpe.br/banon/2001/03.30.15.38.24 | |||
| Next Higher Units | 8JMKD3MGPEW34M/43G4L9S 8JMKD3MGPEW34M/4742MCS | |||
| Citing Item List | sid.inpe.br/sibgrapi/2020/10.28.20.46 33 sid.inpe.br/sibgrapi/2022/06.10.21.49 4 sid.inpe.br/banon/2001/03.30.15.38.24 1 | |||
| Host Collection | sid.inpe.br/banon/2001/03.30.15.38 | |||
| 6. Notes | ||||
| Empty Fields | archivingpolicy archivist area callnumber contenttype copyholder copyright creatorhistory descriptionlevel dissemination edition electronicmailaddress group isbn issn label lineage mark nextedition notes numberofvolumes orcid organization pages parameterlist parentrepositories previousedition previouslowerunit progress project readergroup readpermission resumeid rightsholder schedulinginformation secondarydate secondarykey secondarymark secondarytype serieseditor session shorttitle sponsor subject tertiarymark type url volume | |||
| 7. Description control | ||||
| e-Mail (login) | whendell@copin.ufcg.edu.br | |||
| update | ||||