e2e-model-learning
This repository is by Priya L. Donti, Brandon Amos, and J. Zico Kolter and contains the PyTorch source code to reproduce the experiments in our paper Task-based End-to-end Model Learning.
If you find this repository helpful in your publications, please consider citing our paper.
@article{donti2017task, title={Task-based End-to-end Model Learning}, author={Priya L. Donti and Brandon Amos and J. Zico Kolter}, journal={arXiv preprint arXiv:1703.04529}, year={2017} }
As machine learning techniques have become more ubiquitous, it has become common to see machine learning prediction algorithms operating within some larger process. However, the criteria by which we train machine learning algorithms often differ from the ultimate criteria on which we evaluate them.
This repository demonstrates an end-to-end approach for learning probabilistic machine learning models within the context of stochastic programming, in a manner that directly captures the ultimate task-based objective for which they will be used. Specifically, we evaluate our approach in the context of (a) a generic inventory stock problem and (b) an electrical grid scheduling task based on over eight years of data from PJM.
Please see our paper Task-based End-to-end Model Learning and the code in this repository (locuslab/e2e-model-learning) for more details about the general approach proposed and our initial experimental implementations.
Python 3.x/numpy/scipy/cvxpy
PyTorch 0.3.0
qpth: A fast QP solver for PyTorch released in conjunction with the paper OptNet: Differentiable Optimization as a Layer in Neural Networks.
bamos/block: An intelligent block matrix library for numpy, PyTorch, and beyond.
Optional: bamos/setGPU: A small library to set CUDA_VISIBLE_DEVICES
on multi-GPU systems.
Note: Experiments are currently not working after some library updates. We'll address this ASAP.
Experiments considering a "conditional" variation of the inventory stock problem. Problem instances are generated via random sampling.
newsvendor main.py - Run inventory stock problem experiments. (See arguments.) task_net.py - Functions for our task-based end-to-end model learning approach. mle.py - Functions for linear maximum likelihood estimation approach. mle_net.py - Functions for nonlinear maximum likelihood estimation approach. policy_net.py - Functions for end-to-end neural network policy model. batch.py - Helper functions for minibatched evaluation. plot.py - Plot experimental results.
Experiments considering a realistic grid-scheduling task, in which electricity generation is scheduled based on some (unknown) distribution over electricity demand. Historical load data for these experiments were obtained from PJM.
power_sched main.py - Run load forecasting problem experiments. (See arguments.) model_classes.py - Models used for experiments. nets.py - Functions for RMSE, cost-weighted RMSE, and task nets. plot.py - Plot experimental results. pjm_load_data_*.txt - Historical load data from PJM.
Experiments considering a realistic battery arbitrage task, in which a power grid-connected battery generates a charge/discharge schedule based on some (unknown) distribution over energy prices. Historical energy price data for these experiments were obtained from PJM.
battery_storage main.py - Run battery storage problem experiments. (See arguments.) model_classes.py - Models used for experiments. nets.py - Functions for RMSE and task nets. calc_stats.py - Calculate experimental result stats. storage_data.csv - Historical energy price data from PJM.
This material is based upon work supported by the National Science Foundation Graduate Research Fellowship Program under Grant No. DGE1252522.
Unless otherwise stated, the source code is copyright Carnegie Mellon University and licensed under the Apache 2.0 License.
下一篇:doomnet
还没有评论,说两句吧!
热门资源
Keras-ResNeXt
Keras ResNeXt Implementation of ResNeXt models...
seetafaceJNI
项目介绍 基于中科院seetaface2进行封装的JAVA...
spark-corenlp
This package wraps Stanford CoreNLP annotators ...
capsnet-with-caps...
CapsNet with capsule-wise convolution Project ...
inferno-boilerplate
This is a very basic boilerplate example for pe...
智能在线
400-630-6780
聆听.建议反馈
E-mail: support@tusaishared.com