SwiftOpenPose

This project was developed by transplanting tf-openpose to Swift.
Community cooperation is welcome.

Environment

• iOS11

• Xcode9

Training Model

There are two learning models available for this project.

• OpenPose Caffe-Model

• Convert from OpenPose Caffe-Model to MLModel

• tf-openpose Mobilenet Model (instance_normalization Disabled Version)

• infocom-tpo/tf-openpose .. Model Training and Converter

• MobileOpenPose.mlmodel .. Model Download

Performance comparison

• BenchMark Hardware: iPad 2017

• processing time .. Less than 1 sec

• processing time .. range 2-4 Sec.

• OpenPose Caffe-Model

• tf-openpose Mobilenet Model

Dependencies Library

• UpSurge

• OpenCV

• Download of iOS Pack

• Opencv lightweight version

Installation

$ git clone https://github.com/infocom-tpo/SwiftOpenPose.git
$ cd SwiftOpenPose
$ pod install
$ curl -o SwiftOpenPose/Resources/MobileOpenPose.mlmodel 
https://s3-ap-northeast-1.amazonaws.com/swiftopenpose/MobileOpenPose.mlmodel

Examples

• Bone Detecter
  This app exports a video with detected bones to photo library.
  You can shoot or select a video to detect bones.

iTunes Store App

Stickman Animator

Stickman Animator is an app to make animations of stickman from videos of people.

Blogs

• Explanation by Japanese

• AI初心者がOpenPoseのモバイル実装に取り組んだ話

Reference

• OpenPose

• tf-openpose

• OpenPose Caffe Model Convert to CoreML Model

• エネルギー波を繰り出す女子高生

Development By Infocom TPO

Infocom TPO

License

SwiftOpenPose is available under the MIT license. See the LICENSE file for more info.

Citation

@inproceedings{cao2017realtime,
  author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},
  year = {2017}
}