资源算法CondenseNet-PyTorch

CondenseNet-PyTorch

2020-03-31 | |  46 |   0 |   0

CondenseNet-PyTorch

A PyTorch implementation of CondenseNet: An Efficient DenseNet using Learned Group Convolutions

Table of Contents:

Project structure:

├── agents
|  └── condensenet.py # the main training agent
├── graphs
|  └── models
|  |  └── condensenet.py
|  |  └── denseblock.py
|  |  └── layers.py
|  └── losses
|  |  └── loss.py # contains cross entropy loss definition
├── datasets  # contains all dataloaders for the project
|  └── cifar10.py # dataloader for cifar10 dataset
├── data
|  └── cifar10  # contains raw dataset
├── utils # utilities folder containing metrics , config parsing, etc
|  └── assets
├── main.py
└── run.sh

Data:

Dataloader is responsible for downloading (first time only) and preparing cifar10 data.

Model:

To be able to reproduce the results from the official implementation, we use the default model of cifar10 and its configs as given here.

图片.png

Experiment configs:

- Input size: 32x32x3
- Batch size: 64
- Learning rate: 0.1 following a consine type
- Optimizer: SGD
- Number of epochs: 300
- Condensation Stages: [14, 14, 14]
- Growth Rate: [8, 16, 32]

Usage:

  • To run the project, you need to add your configurations into the folder configs/ as found here

  • sh run.sh

  • To run on a GPU, you need to enable cuda in the config file.

Results:

MetricReproducedOfficial
Top1 error4.78%
Top5 error0.15%

Requirements:

  • Pytorch: 0.4.0

  • torchvision: 0.2.1

  • tensorboardX: 1.2

Check requirements.txt.

Future Work:

  • Add network profiling for counting the number of FLOPS

  • Implement the condensation layers to optimize the model for inference

References:

License:

This project is licensed under MIT License - see the LICENSE file for details.


上一篇:condensenet-tensorflow

下一篇: CondenseNet-chy

用户评价
全部评价

热门资源

  • Keras-ResNeXt

    Keras ResNeXt Implementation of ResNeXt models...

  • seetafaceJNI

    项目介绍 基于中科院seetaface2进行封装的JAVA...

  • spark-corenlp

    This package wraps Stanford CoreNLP annotators ...

  • capsnet-with-caps...

    CapsNet with capsule-wise convolution Project ...

  • inferno-boilerplate

    This is a very basic boilerplate example for pe...