Metadata-Version: 2.1
Name: markovianbandit-pkg
Version: 0.0.5
Summary: Library to compute Gittins and Whittle index for Markovian Bandits
Home-page: https://gitlab.inria.fr/markovianbandit/markovianbandit
Author: Nicolas Gast
Author-email: nicolas.gast@inria.fr
License: UNKNOWN
Project-URL: Bug Tracker, https://gitlab.inria.fr/markovianbandit/markovianbandit/issues
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
License-File: LICENSE

# Markovian Bandits

This repository contains a python library to compute whittle or indices for finite-state Markovian bandit problems. 

## Installation 

To install, just run: 
```
pip install markovianbandit-pkg
```

## Example

```
from markovianbandit import markovianbandit as bandit
model = bandit.random_restless(dim=4)
print(model.whittle_indices()) # should print (True, array([ 0.51679937, -0.09224213,  0.32943948,  0.29512467]))

model = bandit.random_restless(4, seed=2791)
print(model.is_indexable()) # should print False

model = bandit.random_rested(dim=4)
print(model.gittins_indices(discount=.8)) # computes gittins index

```

## Reference




