Maria Castellanos commited on
Commit ·
a48bab8
1
Parent(s): 4280531
add model
Browse files- .gitattributes +1 -0
- README.md +121 -0
- anvil_training/anvil_recipe.yaml +93 -0
- anvil_training/data/X_train.csv +0 -0
- anvil_training/data/y_train.csv +0 -0
- anvil_training/logs/model/version_0/hparams.yaml +5 -0
- anvil_training/logs/model/version_0/metrics.csv +799 -0
- anvil_training/model.json +14 -0
- anvil_training/model.pth +3 -0
- anvil_training/recipe_components/data.yaml +15 -0
- anvil_training/recipe_components/eval.yaml +13 -0
- anvil_training/recipe_components/metadata.yaml +14 -0
- anvil_training/recipe_components/procedure.yaml +47 -0
- expansion_data_inference.csv +0 -0
- meta.yaml +1 -0
- run_model_inference.sh +16 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
anvil_training/model.pth filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,3 +1,124 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
tags:
|
| 6 |
+
- chemistry
|
| 7 |
+
- drug-discovery
|
| 8 |
+
- admet
|
| 9 |
+
- multitask-learning
|
| 10 |
+
- openadmet
|
| 11 |
---
|
| 12 |
+
|
| 13 |
+
This is our baseline Caco-2 permeability/LogD/PPB model. It is a **multitask CheMeleon model** trained to predict the following endpoints:
|
| 14 |
+
|
| 15 |
+
- Caco-2 Permeability Papp A->B
|
| 16 |
+
- Caco-2 Permeability Papp B->A
|
| 17 |
+
- LogD
|
| 18 |
+
- MPPB
|
| 19 |
+
- HPPB
|
| 20 |
+
|
| 21 |
+
## Pre-requisites
|
| 22 |
+
We *highly* recommend you have the Anvil framework from `openadmet-models` installed in an environment (called `openadmet-models`) for ease of use and full utilization of OpenADMET's models. For full documentation, visit our website [here](https://docs.openadmet.org/en/latest/). If you'd like to see some more examples on how to use Anvil, see our demos [here](https://demos.openadmet.org/en/latest/).
|
| 23 |
+
|
| 24 |
+
### Installation of `openadmet-models`
|
| 25 |
+
|
| 26 |
+
#### With conda
|
| 27 |
+
|
| 28 |
+
You can install openadmet-models via our GitHub package. If you want the latest development version, clone the repository and install in editable mode:
|
| 29 |
+
|
| 30 |
+
```
|
| 31 |
+
git clone git@github.com:OpenADMET/openadmet-models.git
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
Set up an environment using the provided files in devtools/conda-envs.
|
| 35 |
+
```
|
| 36 |
+
cd openadmet-models/
|
| 37 |
+
conda env create -f devtools/conda-envs/openadmet-models.yaml
|
| 38 |
+
conda activate openadmet-models
|
| 39 |
+
pip install -e .
|
| 40 |
+
```
|
| 41 |
+
If you want to use GPU acceleration, ensure you have the appropriate CUDA toolkit installed and use the openadmet-models-gpu.yaml file instead:
|
| 42 |
+
```
|
| 43 |
+
conda env create -f devtools/conda-envs/openadmet-models-gpu.yaml
|
| 44 |
+
conda activate openadmet-models
|
| 45 |
+
pip install -e .
|
| 46 |
+
```
|
| 47 |
+
#### With Docker
|
| 48 |
+
Alternatively, you can also use Docker to spin up a containerized pre-installed environment to run `openadmet-models`. Just be sure you are mounting the correct folder (`./permeability-logd-ppb-chemeleon-baseline`) where you've downloaded the model.
|
| 49 |
+
|
| 50 |
+
If you're using a gpu, run:
|
| 51 |
+
```
|
| 52 |
+
docker run -it --user=root --rm \
|
| 53 |
+
-v ./permeability-logd-ppb-chemeleon-baseline:/home/mambauser/model:rw \
|
| 54 |
+
--runtime=nvidia \
|
| 55 |
+
--gpus \
|
| 56 |
+
all ghcr.io/openadmet/openadmet-models:main
|
| 57 |
+
```
|
| 58 |
+
Otherwise, for cpu only:
|
| 59 |
+
```
|
| 60 |
+
docker run -it --user=root --rm \
|
| 61 |
+
-v ./permeability-logd-ppb-chemeleon-baseline:/home/mambauser/model:rw \
|
| 62 |
+
all ghcr.io/openadmet/openadmet-models:main
|
| 63 |
+
```
|
| 64 |
+
|
| 65 |
+
**IMPORTANT NOTE** You will also need `git lfs` installed.
|
| 66 |
+
|
| 67 |
+
## Downloading the model
|
| 68 |
+
|
| 69 |
+
1. After installing Anvil, clone the model repo:
|
| 70 |
+
```
|
| 71 |
+
git clone https://huggingface.co/openadmet/permeability-logd-ppb-chemeleon-baseline/
|
| 72 |
+
```
|
| 73 |
+
2. Change to the repo directory. Ensure you have `git lfs` installed for the repo and get the large model files:
|
| 74 |
+
```
|
| 75 |
+
git lfs install
|
| 76 |
+
git lfs pull
|
| 77 |
+
```
|
| 78 |
+
3. You are now ready to use the model!
|
| 79 |
+
|
| 80 |
+
## Using the model
|
| 81 |
+
|
| 82 |
+
**IMPORTANT NOTE** This model predicts $\log_{10}(P_{app})$ values (on $\log_{10}(cm/s)$). To get $P_{app}$ values in $10^{-6}cm/s$, simply backtransform:
|
| 83 |
+
$$
|
| 84 |
+
P_{app} = 10^{\hat{y}} * 10^{6}
|
| 85 |
+
$$
|
| 86 |
+
|
| 87 |
+
Where $\hat{y}$ is our model prediction.
|
| 88 |
+
|
| 89 |
+
We will use this model for inference, to predict endpoint values for a set of molecular compounds unseen to the model. For demonstration purposes, we will be using a small-molecule set from our recent [OpenADMET-ExpansionRx challenge](https://huggingface.co/spaces/openadmet/OpenADMET-ExpansionRx-Challenge), provided in the file `expansion_data_inference.csv`.
|
| 90 |
+
You can do this either **inside the docker container** as per the instructions above, or if you have installed openadmet-models on your own computer, you can use the appropriate environment.
|
| 91 |
+
|
| 92 |
+
The generic command to run our inference pipeline is:
|
| 93 |
+
```bash
|
| 94 |
+
openadmet predict \
|
| 95 |
+
--input-path <the path to the data to predict on> \
|
| 96 |
+
--input-col <the column of the data to predict on, often SMILES> \
|
| 97 |
+
--model-dir <the anvil_training directory of the model to predict with> \
|
| 98 |
+
--output-csv <the path to an output CSV to save the predictions to> \
|
| 99 |
+
--accelerator <whether to use gpu or cpu, defaults to gpu>
|
| 100 |
+
```
|
| 101 |
+
You can run this directly in your command line, OR you can use the bash script we've provided, `run_model_inference.sh`.
|
| 102 |
+
|
| 103 |
+
For our working example, this command becomes:
|
| 104 |
+
```bash
|
| 105 |
+
openadmet predict \
|
| 106 |
+
--input-path expansion_data_inference.csv \
|
| 107 |
+
--input-col SMILES \
|
| 108 |
+
--model-dir anvil_training/ \
|
| 109 |
+
--output-csv predictions.csv \
|
| 110 |
+
--accelerator cpu
|
| 111 |
+
```
|
| 112 |
+
You can easily substitute your own set of compounds, simply modify the `--input-path` and `--input-col` arguments for your specific dataset.
|
| 113 |
+
|
| 114 |
+
In our example, this outputs a file called `predictions.csv` which includes endpoint-specific prediction columns (as `OADMET_PRED_chemprop_{}`) for:
|
| 115 |
+
|
| 116 |
+
- `caco2_atob_LogPapp`
|
| 117 |
+
- `caco2_btoa_LogPapp`
|
| 118 |
+
- `logD`
|
| 119 |
+
- `mppb_LogUnbound`
|
| 120 |
+
- `hppb_LogUnbound`
|
| 121 |
+
|
| 122 |
+
In this case, `OADMET_STD_chemprop_{}` columns are empty because uncertainty cannot be estimated unless running inference on an ensemble of models. See how to set this option [here](https://demos.openadmet.org/en/latest/demos/04_Ensemble_Model_Training/04_Ensemble_Model_Training_Active_Learning.html).
|
| 123 |
+
|
| 124 |
+
**IMPORTANT NOTE** If you'd like other examples for how to use our Anvil framework, checkout our demos [here](https://demos.openadmet.org/en/latest/).
|
anvil_training/anvil_recipe.yaml
ADDED
|
@@ -0,0 +1,93 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
anvil_dir: file:///home/ec2-user/permeability_models/multitask/all_endpoints_model
|
| 3 |
+
cat_entry: null
|
| 4 |
+
dropna: false
|
| 5 |
+
input_col: OPENADMET_CANONICAL_SMILES
|
| 6 |
+
resource: ../../ChEMBL35_Caco2_permeability_multitask_atob_btoa_logD_mppb_rescaled.parquet
|
| 7 |
+
target_cols:
|
| 8 |
+
- logD
|
| 9 |
+
- caco2_atob_LogPapp
|
| 10 |
+
- caco2_btoa_LogPapp
|
| 11 |
+
- mppb_LogUnbound
|
| 12 |
+
- hppb_LogUnbound
|
| 13 |
+
test_resource: null
|
| 14 |
+
train_resource: null
|
| 15 |
+
type: intake
|
| 16 |
+
val_resource: null
|
| 17 |
+
metadata:
|
| 18 |
+
authors: Maria A. Castellanos
|
| 19 |
+
biotargets:
|
| 20 |
+
- Caco-2
|
| 21 |
+
build_number: 0
|
| 22 |
+
description: basic regression using a ChemProp multitask task model
|
| 23 |
+
driver: pytorch
|
| 24 |
+
email: maria.castellanos@omsf.io
|
| 25 |
+
name: chemprop_pchembl
|
| 26 |
+
tag: chemprop
|
| 27 |
+
tags:
|
| 28 |
+
- openadmet
|
| 29 |
+
- example
|
| 30 |
+
- chemprop
|
| 31 |
+
version: v1
|
| 32 |
+
procedure:
|
| 33 |
+
ensemble: null
|
| 34 |
+
feat:
|
| 35 |
+
params:
|
| 36 |
+
batch_size: 128
|
| 37 |
+
n_jobs: 4
|
| 38 |
+
normalize_targets: true
|
| 39 |
+
type: ChemPropFeaturizer
|
| 40 |
+
model:
|
| 41 |
+
freeze_weights: null
|
| 42 |
+
param_path: null
|
| 43 |
+
params:
|
| 44 |
+
batch_norm: false
|
| 45 |
+
dropout: 0.25
|
| 46 |
+
ffn_hidden_dim: 512
|
| 47 |
+
ffn_hidden_num_layers: 3
|
| 48 |
+
ffn_lr: 1e-3
|
| 49 |
+
ffn_weight_decay: 1e-4
|
| 50 |
+
from_chemeleon: true
|
| 51 |
+
mpnn_lr: 1e-4
|
| 52 |
+
mpnn_weight_decay: 0
|
| 53 |
+
n_tasks: 5
|
| 54 |
+
reduce_lr_factor: 0.5
|
| 55 |
+
reduce_lr_patience: 5
|
| 56 |
+
scheduler: plateau
|
| 57 |
+
serial_path: null
|
| 58 |
+
type: ChemPropModel
|
| 59 |
+
split:
|
| 60 |
+
params:
|
| 61 |
+
random_state: 42
|
| 62 |
+
test_size: 0.0
|
| 63 |
+
train_size: 1.0
|
| 64 |
+
val_size: 0.0
|
| 65 |
+
type: ShuffleSplitter
|
| 66 |
+
train:
|
| 67 |
+
params:
|
| 68 |
+
accelerator: gpu
|
| 69 |
+
early_stopping: true
|
| 70 |
+
early_stopping_min_delta: 0.001
|
| 71 |
+
early_stopping_mode: min
|
| 72 |
+
early_stopping_patience: 20
|
| 73 |
+
gradient_clip_val: 0.5
|
| 74 |
+
max_epochs: 200
|
| 75 |
+
monitor_metric: val_loss
|
| 76 |
+
use_wandb: false
|
| 77 |
+
wandb_project: demos
|
| 78 |
+
type: LightningTrainer
|
| 79 |
+
transform: null
|
| 80 |
+
report:
|
| 81 |
+
eval:
|
| 82 |
+
- params: {}
|
| 83 |
+
type: RegressionMetrics
|
| 84 |
+
- params:
|
| 85 |
+
axes_labels:
|
| 86 |
+
- True LogPapp
|
| 87 |
+
- Predicted LogPapp
|
| 88 |
+
n_repeats: 5
|
| 89 |
+
n_splits: 5
|
| 90 |
+
pXC50: true
|
| 91 |
+
random_state: 42
|
| 92 |
+
title: Multitask True vs Predicted LogPapp on test set
|
| 93 |
+
type: PytorchLightningRepeatedKFoldCrossValidation
|
anvil_training/data/X_train.csv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
anvil_training/data/y_train.csv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
anvil_training/logs/model/version_0/hparams.yaml
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
batch_norm: false
|
| 2 |
+
final_lr: 1.0e-05
|
| 3 |
+
init_lr: 0.0001
|
| 4 |
+
max_lr: 0.001
|
| 5 |
+
warmup_epochs: 2
|
anvil_training/logs/model/version_0/metrics.csv
ADDED
|
@@ -0,0 +1,799 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,step,train_loss_epoch,train_loss_step
|
| 2 |
+
0,49,,0.9781196713447571
|
| 3 |
+
0,99,,0.5188053250312805
|
| 4 |
+
0,149,,0.4172388017177582
|
| 5 |
+
0,199,,0.5668007135391235
|
| 6 |
+
0,232,0.5967047810554504,
|
| 7 |
+
1,249,,0.40170538425445557
|
| 8 |
+
1,299,,0.31435340642929077
|
| 9 |
+
1,349,,0.31079158186912537
|
| 10 |
+
1,399,,0.5218468308448792
|
| 11 |
+
1,449,,0.6680266261100769
|
| 12 |
+
1,465,0.3945891261100769,
|
| 13 |
+
2,499,,0.32706037163734436
|
| 14 |
+
2,549,,0.23362305760383606
|
| 15 |
+
2,599,,0.5701060891151428
|
| 16 |
+
2,649,,0.4605569839477539
|
| 17 |
+
2,698,0.31467100977897644,
|
| 18 |
+
3,699,,0.2150094211101532
|
| 19 |
+
3,749,,0.43613582849502563
|
| 20 |
+
3,799,,0.4241478145122528
|
| 21 |
+
3,849,,0.24332112073898315
|
| 22 |
+
3,899,,0.17995944619178772
|
| 23 |
+
3,931,0.26194003224372864,
|
| 24 |
+
4,949,,0.1358797401189804
|
| 25 |
+
4,999,,0.17095600068569183
|
| 26 |
+
4,1049,,0.1124139279127121
|
| 27 |
+
4,1099,,0.17797376215457916
|
| 28 |
+
4,1149,,0.1393575817346573
|
| 29 |
+
4,1164,0.2246982306241989,
|
| 30 |
+
5,1199,,0.15030537545681
|
| 31 |
+
5,1249,,0.14297890663146973
|
| 32 |
+
5,1299,,0.15206843614578247
|
| 33 |
+
5,1349,,0.13339249789714813
|
| 34 |
+
5,1397,0.191450834274292,
|
| 35 |
+
6,1399,,0.061842773109674454
|
| 36 |
+
6,1449,,0.13477012515068054
|
| 37 |
+
6,1499,,0.0641542449593544
|
| 38 |
+
6,1549,,0.09694936126470566
|
| 39 |
+
6,1599,,0.09821660071611404
|
| 40 |
+
6,1630,0.16744816303253174,
|
| 41 |
+
7,1649,,0.1417410969734192
|
| 42 |
+
7,1699,,0.1403740793466568
|
| 43 |
+
7,1749,,0.06036369130015373
|
| 44 |
+
7,1799,,0.25044381618499756
|
| 45 |
+
7,1849,,0.3270062506198883
|
| 46 |
+
7,1863,0.1461438238620758,
|
| 47 |
+
8,1899,,0.08017916977405548
|
| 48 |
+
8,1949,,0.2208152860403061
|
| 49 |
+
8,1999,,0.07828712463378906
|
| 50 |
+
8,2049,,0.1835923045873642
|
| 51 |
+
8,2096,0.1315426081418991,
|
| 52 |
+
9,2099,,0.17264235019683838
|
| 53 |
+
9,2149,,0.0769258588552475
|
| 54 |
+
9,2199,,0.08432567119598389
|
| 55 |
+
9,2249,,0.06482519209384918
|
| 56 |
+
9,2299,,0.048316650092601776
|
| 57 |
+
9,2329,0.12243183702230453,
|
| 58 |
+
10,2349,,0.0460486114025116
|
| 59 |
+
10,2399,,0.114642433822155
|
| 60 |
+
10,2449,,0.14394474029541016
|
| 61 |
+
10,2499,,0.09048590064048767
|
| 62 |
+
10,2549,,0.10425841808319092
|
| 63 |
+
10,2562,0.10534672439098358,
|
| 64 |
+
11,2599,,0.05577409267425537
|
| 65 |
+
11,2649,,0.06805107742547989
|
| 66 |
+
11,2699,,0.06150142103433609
|
| 67 |
+
11,2749,,0.33150267601013184
|
| 68 |
+
11,2795,0.10354717075824738,
|
| 69 |
+
12,2799,,0.07958871871232986
|
| 70 |
+
12,2849,,0.1425044983625412
|
| 71 |
+
12,2899,,0.06924302130937576
|
| 72 |
+
12,2949,,0.04331598058342934
|
| 73 |
+
12,2999,,0.07445185631513596
|
| 74 |
+
12,3028,0.10292667895555496,
|
| 75 |
+
13,3049,,0.07336984574794769
|
| 76 |
+
13,3099,,0.08479808270931244
|
| 77 |
+
13,3149,,0.05507899448275566
|
| 78 |
+
13,3199,,0.05481494590640068
|
| 79 |
+
13,3249,,0.08469651639461517
|
| 80 |
+
13,3261,0.089226134121418,
|
| 81 |
+
14,3299,,0.04025832936167717
|
| 82 |
+
14,3349,,0.05584246292710304
|
| 83 |
+
14,3399,,0.06666907668113708
|
| 84 |
+
14,3449,,0.07012591511011124
|
| 85 |
+
14,3494,0.07838718593120575,
|
| 86 |
+
15,3499,,0.056400880217552185
|
| 87 |
+
15,3549,,0.049936987459659576
|
| 88 |
+
15,3599,,0.07748711109161377
|
| 89 |
+
15,3649,,0.029488475993275642
|
| 90 |
+
15,3699,,0.05908187851309776
|
| 91 |
+
15,3727,0.08028434962034225,
|
| 92 |
+
16,3749,,0.07860235124826431
|
| 93 |
+
16,3799,,0.0880601704120636
|
| 94 |
+
16,3849,,0.04102602228522301
|
| 95 |
+
16,3899,,0.04515751451253891
|
| 96 |
+
16,3949,,0.19417811930179596
|
| 97 |
+
16,3960,0.083133265376091,
|
| 98 |
+
17,3999,,0.11461348831653595
|
| 99 |
+
17,4049,,0.035498738288879395
|
| 100 |
+
17,4099,,0.08330532908439636
|
| 101 |
+
17,4149,,0.08714041858911514
|
| 102 |
+
17,4193,0.06922087073326111,
|
| 103 |
+
18,4199,,0.03952097147703171
|
| 104 |
+
18,4249,,0.06284266710281372
|
| 105 |
+
18,4299,,0.050608083605766296
|
| 106 |
+
18,4349,,0.022302500903606415
|
| 107 |
+
18,4399,,0.14734108746051788
|
| 108 |
+
18,4426,0.0700310543179512,
|
| 109 |
+
19,4449,,0.03744671121239662
|
| 110 |
+
19,4499,,0.06919052451848984
|
| 111 |
+
19,4549,,0.038604214787483215
|
| 112 |
+
19,4599,,0.051261648535728455
|
| 113 |
+
19,4649,,0.0611330009996891
|
| 114 |
+
19,4659,0.06360835582017899,
|
| 115 |
+
20,4699,,0.09267693758010864
|
| 116 |
+
20,4749,,0.06001728028059006
|
| 117 |
+
20,4799,,0.0814255028963089
|
| 118 |
+
20,4849,,0.13632343709468842
|
| 119 |
+
20,4892,0.06337371468544006,
|
| 120 |
+
21,4899,,0.0676366463303566
|
| 121 |
+
21,4949,,0.06169576570391655
|
| 122 |
+
21,4999,,0.09422094374895096
|
| 123 |
+
21,5049,,0.023442301899194717
|
| 124 |
+
21,5099,,0.037745408713817596
|
| 125 |
+
21,5125,0.06597426533699036,
|
| 126 |
+
22,5149,,0.16991564631462097
|
| 127 |
+
22,5199,,0.04800787195563316
|
| 128 |
+
22,5249,,0.05044173449277878
|
| 129 |
+
22,5299,,0.02857021801173687
|
| 130 |
+
22,5349,,0.04038986563682556
|
| 131 |
+
22,5358,0.07110031694173813,
|
| 132 |
+
23,5399,,0.05177393555641174
|
| 133 |
+
23,5449,,0.05454722419381142
|
| 134 |
+
23,5499,,0.06335316598415375
|
| 135 |
+
23,5549,,0.0391240194439888
|
| 136 |
+
23,5591,0.050620272755622864,
|
| 137 |
+
24,5599,,0.02705218642950058
|
| 138 |
+
24,5649,,0.048712193965911865
|
| 139 |
+
24,5699,,0.04236499220132828
|
| 140 |
+
24,5749,,0.025016091763973236
|
| 141 |
+
24,5799,,0.2223322093486786
|
| 142 |
+
24,5824,0.05181926116347313,
|
| 143 |
+
25,5849,,0.0888863205909729
|
| 144 |
+
25,5899,,0.05919940397143364
|
| 145 |
+
25,5949,,0.07385910302400589
|
| 146 |
+
25,5999,,0.07656605541706085
|
| 147 |
+
25,6049,,0.13181981444358826
|
| 148 |
+
25,6057,0.0656149610877037,
|
| 149 |
+
26,6099,,0.05413954704999924
|
| 150 |
+
26,6149,,0.05523274093866348
|
| 151 |
+
26,6199,,0.038041986525058746
|
| 152 |
+
26,6249,,0.018460527062416077
|
| 153 |
+
26,6290,0.055361028760671616,
|
| 154 |
+
27,6299,,0.06857875734567642
|
| 155 |
+
27,6349,,0.023595184087753296
|
| 156 |
+
27,6399,,0.04772178828716278
|
| 157 |
+
27,6449,,0.06056066229939461
|
| 158 |
+
27,6499,,0.06419448554515839
|
| 159 |
+
27,6523,0.0560297928750515,
|
| 160 |
+
28,6549,,0.03243432939052582
|
| 161 |
+
28,6599,,0.02729768492281437
|
| 162 |
+
28,6649,,0.03501734137535095
|
| 163 |
+
28,6699,,0.03558112308382988
|
| 164 |
+
28,6749,,0.046969976276159286
|
| 165 |
+
28,6756,0.040195345878601074,
|
| 166 |
+
29,6799,,0.048745106905698776
|
| 167 |
+
29,6849,,0.06518510729074478
|
| 168 |
+
29,6899,,0.03547127917408943
|
| 169 |
+
29,6949,,0.05089491233229637
|
| 170 |
+
29,6989,0.05161628499627113,
|
| 171 |
+
30,6999,,0.036542363464832306
|
| 172 |
+
30,7049,,0.05947002023458481
|
| 173 |
+
30,7099,,0.05110417678952217
|
| 174 |
+
30,7149,,0.049922600388526917
|
| 175 |
+
30,7199,,0.02692374773323536
|
| 176 |
+
30,7222,0.048779379576444626,
|
| 177 |
+
31,7249,,0.03379150852560997
|
| 178 |
+
31,7299,,0.07708773016929626
|
| 179 |
+
31,7349,,0.04396437481045723
|
| 180 |
+
31,7399,,0.06993021816015244
|
| 181 |
+
31,7449,,0.0570831373333931
|
| 182 |
+
31,7455,0.05120982602238655,
|
| 183 |
+
32,7499,,0.03399725630879402
|
| 184 |
+
32,7549,,0.14329299330711365
|
| 185 |
+
32,7599,,0.02264322340488434
|
| 186 |
+
32,7649,,0.039611149579286575
|
| 187 |
+
32,7688,0.05079389363527298,
|
| 188 |
+
33,7699,,0.09805820137262344
|
| 189 |
+
33,7749,,0.03994247689843178
|
| 190 |
+
33,7799,,0.04653069004416466
|
| 191 |
+
33,7849,,0.054189737886190414
|
| 192 |
+
33,7899,,0.0407494455575943
|
| 193 |
+
33,7921,0.052060578018426895,
|
| 194 |
+
34,7949,,0.02590177021920681
|
| 195 |
+
34,7999,,0.04000856727361679
|
| 196 |
+
34,8049,,0.04667581245303154
|
| 197 |
+
34,8099,,0.03172371909022331
|
| 198 |
+
34,8149,,0.03767998516559601
|
| 199 |
+
34,8154,0.039249662309885025,
|
| 200 |
+
35,8199,,0.07415590435266495
|
| 201 |
+
35,8249,,0.043197132647037506
|
| 202 |
+
35,8299,,0.04284992069005966
|
| 203 |
+
35,8349,,0.0719987154006958
|
| 204 |
+
35,8387,0.04648414999246597,
|
| 205 |
+
36,8399,,0.04710324853658676
|
| 206 |
+
36,8449,,0.02300715073943138
|
| 207 |
+
36,8499,,0.027295563369989395
|
| 208 |
+
36,8549,,0.037202540785074234
|
| 209 |
+
36,8599,,0.031333908438682556
|
| 210 |
+
36,8620,0.0447365865111351,
|
| 211 |
+
37,8649,,0.03890945389866829
|
| 212 |
+
37,8699,,0.03619258478283882
|
| 213 |
+
37,8749,,0.019218752160668373
|
| 214 |
+
37,8799,,0.025540076196193695
|
| 215 |
+
37,8849,,0.04414200782775879
|
| 216 |
+
37,8853,0.0368005707859993,
|
| 217 |
+
38,8899,,0.024949198588728905
|
| 218 |
+
38,8949,,0.024182504042983055
|
| 219 |
+
38,8999,,0.04157062992453575
|
| 220 |
+
38,9049,,0.03511962294578552
|
| 221 |
+
38,9086,0.038144517689943314,
|
| 222 |
+
39,9099,,0.034238122403621674
|
| 223 |
+
39,9149,,0.07992681860923767
|
| 224 |
+
39,9199,,0.035583410412073135
|
| 225 |
+
39,9249,,0.031946223229169846
|
| 226 |
+
39,9299,,0.039652250707149506
|
| 227 |
+
39,9319,0.04573826119303703,
|
| 228 |
+
40,9349,,0.03342490270733833
|
| 229 |
+
40,9399,,0.03202459588646889
|
| 230 |
+
40,9449,,0.016030456870794296
|
| 231 |
+
40,9499,,0.02725359797477722
|
| 232 |
+
40,9549,,0.04667072743177414
|
| 233 |
+
40,9552,0.03469839319586754,
|
| 234 |
+
41,9599,,0.02457886002957821
|
| 235 |
+
41,9649,,0.029376346617937088
|
| 236 |
+
41,9699,,0.025892267003655434
|
| 237 |
+
41,9749,,0.07114774733781815
|
| 238 |
+
41,9785,0.032746974378824234,
|
| 239 |
+
42,9799,,0.04335075989365578
|
| 240 |
+
42,9849,,0.03730068728327751
|
| 241 |
+
42,9899,,0.0644807368516922
|
| 242 |
+
42,9949,,0.029070377349853516
|
| 243 |
+
42,9999,,0.0665367990732193
|
| 244 |
+
42,10018,0.043127235025167465,
|
| 245 |
+
43,10049,,0.022104596719145775
|
| 246 |
+
43,10099,,0.04854988306760788
|
| 247 |
+
43,10149,,0.052581265568733215
|
| 248 |
+
43,10199,,0.0481957346200943
|
| 249 |
+
43,10249,,0.016892345622181892
|
| 250 |
+
43,10251,0.04314756393432617,
|
| 251 |
+
44,10299,,0.02020653523504734
|
| 252 |
+
44,10349,,0.04440908133983612
|
| 253 |
+
44,10399,,0.02124502882361412
|
| 254 |
+
44,10449,,0.06817551702260971
|
| 255 |
+
44,10484,0.04067850485444069,
|
| 256 |
+
45,10499,,0.016907187178730965
|
| 257 |
+
45,10549,,0.03728348761796951
|
| 258 |
+
45,10599,,0.06583327800035477
|
| 259 |
+
45,10649,,0.038291964679956436
|
| 260 |
+
45,10699,,0.030495375394821167
|
| 261 |
+
45,10717,0.03282175958156586,
|
| 262 |
+
46,10749,,0.02048608474433422
|
| 263 |
+
46,10799,,0.024171175435185432
|
| 264 |
+
46,10849,,0.029224112629890442
|
| 265 |
+
46,10899,,0.03343479335308075
|
| 266 |
+
46,10949,,0.02478986606001854
|
| 267 |
+
46,10950,0.037528570741415024,
|
| 268 |
+
47,10999,,0.029862411320209503
|
| 269 |
+
47,11049,,0.03713463991880417
|
| 270 |
+
47,11099,,0.03420879319310188
|
| 271 |
+
47,11149,,0.07011330872774124
|
| 272 |
+
47,11183,0.041649945080280304,
|
| 273 |
+
48,11199,,0.027073826640844345
|
| 274 |
+
48,11249,,0.025814339518547058
|
| 275 |
+
48,11299,,0.04928593710064888
|
| 276 |
+
48,11349,,0.03412342816591263
|
| 277 |
+
48,11399,,0.036903250962495804
|
| 278 |
+
48,11416,0.038343049585819244,
|
| 279 |
+
49,11449,,0.03057154454290867
|
| 280 |
+
49,11499,,0.031167030334472656
|
| 281 |
+
49,11549,,0.013768763281404972
|
| 282 |
+
49,11599,,0.027419738471508026
|
| 283 |
+
49,11649,,0.02381688356399536
|
| 284 |
+
49,11649,0.026815785095095634,
|
| 285 |
+
50,11699,,0.04308406263589859
|
| 286 |
+
50,11749,,0.014739257283508778
|
| 287 |
+
50,11799,,0.04027842730283737
|
| 288 |
+
50,11849,,0.021697254851460457
|
| 289 |
+
50,11882,0.022889846935868263,
|
| 290 |
+
51,11899,,0.009665418416261673
|
| 291 |
+
51,11949,,0.015529194846749306
|
| 292 |
+
51,11999,,0.03188738971948624
|
| 293 |
+
51,12049,,0.03507628291845322
|
| 294 |
+
51,12099,,0.020320162177085876
|
| 295 |
+
51,12115,0.02245517261326313,
|
| 296 |
+
52,12149,,0.020910289138555527
|
| 297 |
+
52,12199,,0.014244514517486095
|
| 298 |
+
52,12249,,0.02076144516468048
|
| 299 |
+
52,12299,,0.04021155461668968
|
| 300 |
+
52,12348,0.02100306749343872,
|
| 301 |
+
53,12349,,0.015516445972025394
|
| 302 |
+
53,12399,,0.029440879821777344
|
| 303 |
+
53,12449,,0.026881836354732513
|
| 304 |
+
53,12499,,0.04428185522556305
|
| 305 |
+
53,12549,,0.013184783980250359
|
| 306 |
+
53,12581,0.02054700255393982,
|
| 307 |
+
54,12599,,0.014740287326276302
|
| 308 |
+
54,12649,,0.014811485074460506
|
| 309 |
+
54,12699,,0.050230178982019424
|
| 310 |
+
54,12749,,0.01579219475388527
|
| 311 |
+
54,12799,,0.013154199346899986
|
| 312 |
+
54,12814,0.019415931776165962,
|
| 313 |
+
55,12849,,0.01759403944015503
|
| 314 |
+
55,12899,,0.022916141897439957
|
| 315 |
+
55,12949,,0.011409372091293335
|
| 316 |
+
55,12999,,0.01176859438419342
|
| 317 |
+
55,13047,0.019173450767993927,
|
| 318 |
+
56,13049,,0.01411499921232462
|
| 319 |
+
56,13099,,0.015891948714852333
|
| 320 |
+
56,13149,,0.014531861990690231
|
| 321 |
+
56,13199,,0.020477071404457092
|
| 322 |
+
56,13249,,0.019630191847682
|
| 323 |
+
56,13280,0.02156912162899971,
|
| 324 |
+
57,13299,,0.030056564137339592
|
| 325 |
+
57,13349,,0.01568136364221573
|
| 326 |
+
57,13399,,0.011954088695347309
|
| 327 |
+
57,13449,,0.013162550516426563
|
| 328 |
+
57,13499,,0.07792185246944427
|
| 329 |
+
57,13513,0.02316400781273842,
|
| 330 |
+
58,13549,,0.025784768164157867
|
| 331 |
+
58,13599,,0.024627553299069405
|
| 332 |
+
58,13649,,0.030907295644283295
|
| 333 |
+
58,13699,,0.02679361216723919
|
| 334 |
+
58,13746,0.02366592362523079,
|
| 335 |
+
59,13749,,0.01159858237951994
|
| 336 |
+
59,13799,,0.033839330077171326
|
| 337 |
+
59,13849,,0.03137169033288956
|
| 338 |
+
59,13899,,0.009843239560723305
|
| 339 |
+
59,13949,,0.009268684312701225
|
| 340 |
+
59,13979,0.023474013432860374,
|
| 341 |
+
60,13999,,0.03938756510615349
|
| 342 |
+
60,14049,,0.02775568515062332
|
| 343 |
+
60,14099,,0.02392936870455742
|
| 344 |
+
60,14149,,0.01927240937948227
|
| 345 |
+
60,14199,,0.017045823857188225
|
| 346 |
+
60,14212,0.021403346210718155,
|
| 347 |
+
61,14249,,0.009746083058416843
|
| 348 |
+
61,14299,,0.01225332636386156
|
| 349 |
+
61,14349,,0.014065410010516644
|
| 350 |
+
61,14399,,0.02647019736468792
|
| 351 |
+
61,14445,0.019574718549847603,
|
| 352 |
+
62,14449,,0.01705792360007763
|
| 353 |
+
62,14499,,0.04200773313641548
|
| 354 |
+
62,14549,,0.016878720372915268
|
| 355 |
+
62,14599,,0.020176678895950317
|
| 356 |
+
62,14649,,0.009628033265471458
|
| 357 |
+
62,14678,0.024437952786684036,
|
| 358 |
+
63,14699,,0.012443630956113338
|
| 359 |
+
63,14749,,0.015057109296321869
|
| 360 |
+
63,14799,,0.01606735773384571
|
| 361 |
+
63,14849,,0.013969162479043007
|
| 362 |
+
63,14899,,0.02002536505460739
|
| 363 |
+
63,14911,0.020444611087441444,
|
| 364 |
+
64,14949,,0.03022288717329502
|
| 365 |
+
64,14999,,0.01323009468615055
|
| 366 |
+
64,15049,,0.02545197680592537
|
| 367 |
+
64,15099,,0.010245569981634617
|
| 368 |
+
64,15144,0.01773940585553646,
|
| 369 |
+
65,15149,,0.013383843004703522
|
| 370 |
+
65,15199,,0.011288399808108807
|
| 371 |
+
65,15249,,0.01123131811618805
|
| 372 |
+
65,15299,,0.011422884650528431
|
| 373 |
+
65,15349,,0.010151165537536144
|
| 374 |
+
65,15377,0.01607241854071617,
|
| 375 |
+
66,15399,,0.017162185162305832
|
| 376 |
+
66,15449,,0.012982919812202454
|
| 377 |
+
66,15499,,0.009785326197743416
|
| 378 |
+
66,15549,,0.008285196498036385
|
| 379 |
+
66,15599,,0.023085830733180046
|
| 380 |
+
66,15610,0.01536955963820219,
|
| 381 |
+
67,15649,,0.03951169550418854
|
| 382 |
+
67,15699,,0.008769160136580467
|
| 383 |
+
67,15749,,0.019500715658068657
|
| 384 |
+
67,15799,,0.010686660185456276
|
| 385 |
+
67,15843,0.014380306005477905,
|
| 386 |
+
68,15849,,0.011538452468812466
|
| 387 |
+
68,15899,,0.016681242734193802
|
| 388 |
+
68,15949,,0.010189036838710308
|
| 389 |
+
68,15999,,0.00833972729742527
|
| 390 |
+
68,16049,,0.011182776652276516
|
| 391 |
+
68,16076,0.013873722404241562,
|
| 392 |
+
69,16099,,0.012912469916045666
|
| 393 |
+
69,16149,,0.011790958233177662
|
| 394 |
+
69,16199,,0.009379038587212563
|
| 395 |
+
69,16249,,0.016848187893629074
|
| 396 |
+
69,16299,,0.011755463667213917
|
| 397 |
+
69,16309,0.014158600009977818,
|
| 398 |
+
70,16349,,0.030424807220697403
|
| 399 |
+
70,16399,,0.014991297386586666
|
| 400 |
+
70,16449,,0.01172870397567749
|
| 401 |
+
70,16499,,0.01876993663609028
|
| 402 |
+
70,16542,0.013123802840709686,
|
| 403 |
+
71,16549,,0.015601775608956814
|
| 404 |
+
71,16599,,0.010485561564564705
|
| 405 |
+
71,16649,,0.009183624759316444
|
| 406 |
+
71,16699,,0.008191649802029133
|
| 407 |
+
71,16749,,0.012665375135838985
|
| 408 |
+
71,16775,0.013269945047795773,
|
| 409 |
+
72,16799,,0.016645630821585655
|
| 410 |
+
72,16849,,0.013750598765909672
|
| 411 |
+
72,16899,,0.012924432754516602
|
| 412 |
+
72,16949,,0.007964813150465488
|
| 413 |
+
72,16999,,0.010726666077971458
|
| 414 |
+
72,17008,0.012400693260133266,
|
| 415 |
+
73,17049,,0.014438719488680363
|
| 416 |
+
73,17099,,0.012546678073704243
|
| 417 |
+
73,17149,,0.01671169139444828
|
| 418 |
+
73,17199,,0.012266173027455807
|
| 419 |
+
73,17241,0.013181381858885288,
|
| 420 |
+
74,17249,,0.009332988411188126
|
| 421 |
+
74,17299,,0.009313647635281086
|
| 422 |
+
74,17349,,0.006196092814207077
|
| 423 |
+
74,17399,,0.007162331137806177
|
| 424 |
+
74,17449,,0.022599704563617706
|
| 425 |
+
74,17474,0.012488004751503468,
|
| 426 |
+
75,17499,,0.010622385889291763
|
| 427 |
+
75,17549,,0.00992902647703886
|
| 428 |
+
75,17599,,0.01027025654911995
|
| 429 |
+
75,17649,,0.011277811601758003
|
| 430 |
+
75,17699,,0.010832429863512516
|
| 431 |
+
75,17707,0.012438989244401455,
|
| 432 |
+
76,17749,,0.012987510301172733
|
| 433 |
+
76,17799,,0.008428554981946945
|
| 434 |
+
76,17849,,0.009375380352139473
|
| 435 |
+
76,17899,,0.007473239209502935
|
| 436 |
+
76,17940,0.012325131334364414,
|
| 437 |
+
77,17949,,0.014484778977930546
|
| 438 |
+
77,17999,,0.0075533525086939335
|
| 439 |
+
77,18049,,0.008731091395020485
|
| 440 |
+
77,18099,,0.011290667578577995
|
| 441 |
+
77,18149,,0.013907559216022491
|
| 442 |
+
77,18173,0.011834160424768925,
|
| 443 |
+
78,18199,,0.009607281535863876
|
| 444 |
+
78,18249,,0.009125184267759323
|
| 445 |
+
78,18299,,0.009831167757511139
|
| 446 |
+
78,18349,,0.01084428746253252
|
| 447 |
+
78,18399,,0.08651471883058548
|
| 448 |
+
78,18406,0.012310071848332882,
|
| 449 |
+
79,18449,,0.00999101810157299
|
| 450 |
+
79,18499,,0.02118723653256893
|
| 451 |
+
79,18549,,0.008504064753651619
|
| 452 |
+
79,18599,,0.014103724621236324
|
| 453 |
+
79,18639,0.012438567355275154,
|
| 454 |
+
80,18649,,0.012329409830272198
|
| 455 |
+
80,18699,,0.02373524196445942
|
| 456 |
+
80,18749,,0.007249414920806885
|
| 457 |
+
80,18799,,0.01257007010281086
|
| 458 |
+
80,18849,,0.009655717760324478
|
| 459 |
+
80,18872,0.012100978754460812,
|
| 460 |
+
81,18899,,0.008723409846425056
|
| 461 |
+
81,18949,,0.008556880056858063
|
| 462 |
+
81,18999,,0.0121050039306283
|
| 463 |
+
81,19049,,0.01161923911422491
|
| 464 |
+
81,19099,,0.011274706572294235
|
| 465 |
+
81,19105,0.012260306626558304,
|
| 466 |
+
82,19149,,0.009180237539112568
|
| 467 |
+
82,19199,,0.015189701691269875
|
| 468 |
+
82,19249,,0.01104743778705597
|
| 469 |
+
82,19299,,0.008228017948567867
|
| 470 |
+
82,19338,0.012209893204271793,
|
| 471 |
+
83,19349,,0.013740824535489082
|
| 472 |
+
83,19399,,0.009296142496168613
|
| 473 |
+
83,19449,,0.012390985153615475
|
| 474 |
+
83,19499,,0.02199133299291134
|
| 475 |
+
83,19549,,0.007197687402367592
|
| 476 |
+
83,19571,0.012731318362057209,
|
| 477 |
+
84,19599,,0.01804499328136444
|
| 478 |
+
84,19649,,0.025122037157416344
|
| 479 |
+
84,19699,,0.00985637865960598
|
| 480 |
+
84,19749,,0.008265969343483448
|
| 481 |
+
84,19799,,0.01638331264257431
|
| 482 |
+
84,19804,0.014814550057053566,
|
| 483 |
+
85,19849,,0.01603962481021881
|
| 484 |
+
85,19899,,0.008784090168774128
|
| 485 |
+
85,19949,,0.009367906488478184
|
| 486 |
+
85,19999,,0.0210042092949152
|
| 487 |
+
85,20037,0.013504604808986187,
|
| 488 |
+
86,20049,,0.007207389455288649
|
| 489 |
+
86,20099,,0.00864070001989603
|
| 490 |
+
86,20149,,0.011268459260463715
|
| 491 |
+
86,20199,,0.007223770022392273
|
| 492 |
+
86,20249,,0.01171328779309988
|
| 493 |
+
86,20270,0.012282353825867176,
|
| 494 |
+
87,20299,,0.03952428326010704
|
| 495 |
+
87,20349,,0.013649888336658478
|
| 496 |
+
87,20399,,0.009539869613945484
|
| 497 |
+
87,20449,,0.010559165850281715
|
| 498 |
+
87,20499,,0.020913757383823395
|
| 499 |
+
87,20503,0.01216243114322424,
|
| 500 |
+
88,20549,,0.00974198803305626
|
| 501 |
+
88,20599,,0.008700666017830372
|
| 502 |
+
88,20649,,0.0136112654581666
|
| 503 |
+
88,20699,,0.00631662318482995
|
| 504 |
+
88,20736,0.011909127235412598,
|
| 505 |
+
89,20749,,0.00828890223056078
|
| 506 |
+
89,20799,,0.008095502853393555
|
| 507 |
+
89,20849,,0.009632572531700134
|
| 508 |
+
89,20899,,0.009283551014959812
|
| 509 |
+
89,20949,,0.009867608547210693
|
| 510 |
+
89,20969,0.011236408725380898,
|
| 511 |
+
90,20999,,0.010244566947221756
|
| 512 |
+
90,21049,,0.014270391315221786
|
| 513 |
+
90,21099,,0.008844885975122452
|
| 514 |
+
90,21149,,0.010465869680047035
|
| 515 |
+
90,21199,,0.020097170025110245
|
| 516 |
+
90,21202,0.01119254156947136,
|
| 517 |
+
91,21249,,0.008599667809903622
|
| 518 |
+
91,21299,,0.008887047879397869
|
| 519 |
+
91,21349,,0.00966575276106596
|
| 520 |
+
91,21399,,0.0483819954097271
|
| 521 |
+
91,21435,0.01116661075502634,
|
| 522 |
+
92,21449,,0.008002564311027527
|
| 523 |
+
92,21499,,0.0077667152509093285
|
| 524 |
+
92,21549,,0.01422396395355463
|
| 525 |
+
92,21599,,0.017090551555156708
|
| 526 |
+
92,21649,,0.007748427335172892
|
| 527 |
+
92,21668,0.010742527432739735,
|
| 528 |
+
93,21699,,0.007330714259296656
|
| 529 |
+
93,21749,,0.0067668333649635315
|
| 530 |
+
93,21799,,0.01853134296834469
|
| 531 |
+
93,21849,,0.010422656312584877
|
| 532 |
+
93,21899,,0.004994779359549284
|
| 533 |
+
93,21901,0.010509929619729519,
|
| 534 |
+
94,21949,,0.005100528709590435
|
| 535 |
+
94,21999,,0.011793495155870914
|
| 536 |
+
94,22049,,0.007109381724148989
|
| 537 |
+
94,22099,,0.009968251921236515
|
| 538 |
+
94,22134,0.010136271826922894,
|
| 539 |
+
95,22149,,0.007859839126467705
|
| 540 |
+
95,22199,,0.014997732825577259
|
| 541 |
+
95,22249,,0.013193503022193909
|
| 542 |
+
95,22299,,0.007750023156404495
|
| 543 |
+
95,22349,,0.01251092180609703
|
| 544 |
+
95,22367,0.010636497288942337,
|
| 545 |
+
96,22399,,0.00472773052752018
|
| 546 |
+
96,22449,,0.010807463899254799
|
| 547 |
+
96,22499,,0.008131821639835835
|
| 548 |
+
96,22549,,0.0066901003010571
|
| 549 |
+
96,22599,,0.009256426244974136
|
| 550 |
+
96,22600,0.009883932769298553,
|
| 551 |
+
97,22649,,0.012555822730064392
|
| 552 |
+
97,22699,,0.009329312480986118
|
| 553 |
+
97,22749,,0.005677599925547838
|
| 554 |
+
97,22799,,0.00946832075715065
|
| 555 |
+
97,22833,0.010213701985776424,
|
| 556 |
+
98,22849,,0.013071042485535145
|
| 557 |
+
98,22899,,0.01071584690362215
|
| 558 |
+
98,22949,,0.013170363381505013
|
| 559 |
+
98,22999,,0.010615585371851921
|
| 560 |
+
98,23049,,0.025251155719161034
|
| 561 |
+
98,23066,0.010050089098513126,
|
| 562 |
+
99,23099,,0.021966515108942986
|
| 563 |
+
99,23149,,0.007157896179705858
|
| 564 |
+
99,23199,,0.009163573384284973
|
| 565 |
+
99,23249,,0.010632473975419998
|
| 566 |
+
99,23299,,0.008124726824462414
|
| 567 |
+
99,23299,0.010232177563011646,
|
| 568 |
+
100,23349,,0.018834497779607773
|
| 569 |
+
100,23399,,0.007206527981907129
|
| 570 |
+
100,23449,,0.009603036567568779
|
| 571 |
+
100,23499,,0.008565641939640045
|
| 572 |
+
100,23532,0.009783160872757435,
|
| 573 |
+
101,23549,,0.007550579961389303
|
| 574 |
+
101,23599,,0.011143269948661327
|
| 575 |
+
101,23649,,0.00864416267722845
|
| 576 |
+
101,23699,,0.006763931829482317
|
| 577 |
+
101,23749,,0.011101005598902702
|
| 578 |
+
101,23765,0.00949318427592516,
|
| 579 |
+
102,23799,,0.008981946855783463
|
| 580 |
+
102,23849,,0.004777817986905575
|
| 581 |
+
102,23899,,0.01364970300346613
|
| 582 |
+
102,23949,,0.011660045012831688
|
| 583 |
+
102,23998,0.009460101835429668,
|
| 584 |
+
103,23999,,0.008608500473201275
|
| 585 |
+
103,24049,,0.009194415993988514
|
| 586 |
+
103,24099,,0.00756433280184865
|
| 587 |
+
103,24149,,0.006378332618623972
|
| 588 |
+
103,24199,,0.009131166152656078
|
| 589 |
+
103,24231,0.009468501433730125,
|
| 590 |
+
104,24249,,0.007010235451161861
|
| 591 |
+
104,24299,,0.007963284850120544
|
| 592 |
+
104,24349,,0.05550863966345787
|
| 593 |
+
104,24399,,0.006463226862251759
|
| 594 |
+
104,24449,,0.010473793372511864
|
| 595 |
+
104,24464,0.009219811297953129,
|
| 596 |
+
105,24499,,0.007868734188377857
|
| 597 |
+
105,24549,,0.007729876786470413
|
| 598 |
+
105,24599,,0.006053104065358639
|
| 599 |
+
105,24649,,0.006294563878327608
|
| 600 |
+
105,24697,0.00937480665743351,
|
| 601 |
+
106,24699,,0.008584842085838318
|
| 602 |
+
106,24749,,0.012170390225946903
|
| 603 |
+
106,24799,,0.006558562628924847
|
| 604 |
+
106,24849,,0.006365340668708086
|
| 605 |
+
106,24899,,0.009135046973824501
|
| 606 |
+
106,24930,0.009154938161373138,
|
| 607 |
+
107,24949,,0.013552608899772167
|
| 608 |
+
107,24999,,0.008870783261954784
|
| 609 |
+
107,25049,,0.005260922014713287
|
| 610 |
+
107,25099,,0.009735574945807457
|
| 611 |
+
107,25149,,0.015945330262184143
|
| 612 |
+
107,25163,0.00921320728957653,
|
| 613 |
+
108,25199,,0.017853258177638054
|
| 614 |
+
108,25249,,0.012140416540205479
|
| 615 |
+
108,25299,,0.004484710283577442
|
| 616 |
+
108,25349,,0.008458084426820278
|
| 617 |
+
108,25396,0.009133687242865562,
|
| 618 |
+
109,25399,,0.0071701956912875175
|
| 619 |
+
109,25449,,0.006333579774945974
|
| 620 |
+
109,25499,,0.007580679841339588
|
| 621 |
+
109,25549,,0.005078890360891819
|
| 622 |
+
109,25599,,0.0065825823694467545
|
| 623 |
+
109,25629,0.00919408816844225,
|
| 624 |
+
110,25649,,0.008064880967140198
|
| 625 |
+
110,25699,,0.00929039716720581
|
| 626 |
+
110,25749,,0.009787668474018574
|
| 627 |
+
110,25799,,0.007239412050694227
|
| 628 |
+
110,25849,,0.007461087312549353
|
| 629 |
+
110,25862,0.009005999192595482,
|
| 630 |
+
111,25899,,0.008147509768605232
|
| 631 |
+
111,25949,,0.004873862490057945
|
| 632 |
+
111,25999,,0.007436844054609537
|
| 633 |
+
111,26049,,0.008126542903482914
|
| 634 |
+
111,26095,0.008990668691694736,
|
| 635 |
+
112,26099,,0.008499368093907833
|
| 636 |
+
112,26149,,0.007514809723943472
|
| 637 |
+
112,26199,,0.005465700291097164
|
| 638 |
+
112,26249,,0.007862327620387077
|
| 639 |
+
112,26299,,0.005882487166672945
|
| 640 |
+
112,26328,0.00888657197356224,
|
| 641 |
+
113,26349,,0.0056334082037210464
|
| 642 |
+
113,26399,,0.00853637233376503
|
| 643 |
+
113,26449,,0.0047028036788105965
|
| 644 |
+
113,26499,,0.007765656802803278
|
| 645 |
+
113,26549,,0.007744417991489172
|
| 646 |
+
113,26561,0.008866281248629093,
|
| 647 |
+
114,26599,,0.007275634445250034
|
| 648 |
+
114,26649,,0.007499241270124912
|
| 649 |
+
114,26699,,0.012734834104776382
|
| 650 |
+
114,26749,,0.007764542009681463
|
| 651 |
+
114,26794,0.008873171173036098,
|
| 652 |
+
115,26799,,0.005998617969453335
|
| 653 |
+
115,26849,,0.006248430348932743
|
| 654 |
+
115,26899,,0.004960114136338234
|
| 655 |
+
115,26949,,0.0053023225627839565
|
| 656 |
+
115,26999,,0.007784090470522642
|
| 657 |
+
115,27027,0.008631293661892414,
|
| 658 |
+
116,27049,,0.020947542041540146
|
| 659 |
+
116,27099,,0.007255012169480324
|
| 660 |
+
116,27149,,0.005884598009288311
|
| 661 |
+
116,27199,,0.005914670415222645
|
| 662 |
+
116,27249,,0.013698103837668896
|
| 663 |
+
116,27260,0.00901118665933609,
|
| 664 |
+
117,27299,,0.010400929488241673
|
| 665 |
+
117,27349,,0.0060319602489471436
|
| 666 |
+
117,27399,,0.017185894772410393
|
| 667 |
+
117,27449,,0.006376294419169426
|
| 668 |
+
117,27493,0.008654482662677765,
|
| 669 |
+
118,27499,,0.006112037226557732
|
| 670 |
+
118,27549,,0.009709403850138187
|
| 671 |
+
118,27599,,0.011542784981429577
|
| 672 |
+
118,27649,,0.006316347513347864
|
| 673 |
+
118,27699,,0.007380709517747164
|
| 674 |
+
118,27726,0.00860694982111454,
|
| 675 |
+
119,27749,,0.0051675173453986645
|
| 676 |
+
119,27799,,0.008363517001271248
|
| 677 |
+
119,27849,,0.006931686773896217
|
| 678 |
+
119,27899,,0.011661438271403313
|
| 679 |
+
119,27949,,0.008507467806339264
|
| 680 |
+
119,27959,0.00849993247538805,
|
| 681 |
+
120,27999,,0.01423876266926527
|
| 682 |
+
120,28049,,0.007003788836300373
|
| 683 |
+
120,28099,,0.007078069262206554
|
| 684 |
+
120,28149,,0.013359297066926956
|
| 685 |
+
120,28192,0.00836015772074461,
|
| 686 |
+
121,28199,,0.009029611013829708
|
| 687 |
+
121,28249,,0.006018614862114191
|
| 688 |
+
121,28299,,0.0072647156193852425
|
| 689 |
+
121,28349,,0.005743059329688549
|
| 690 |
+
121,28399,,0.0063291615806519985
|
| 691 |
+
121,28425,0.008449426852166653,
|
| 692 |
+
122,28449,,0.011916104704141617
|
| 693 |
+
122,28499,,0.006538670975714922
|
| 694 |
+
122,28549,,0.006099531892687082
|
| 695 |
+
122,28599,,0.007182166446000338
|
| 696 |
+
122,28649,,0.006912669632583857
|
| 697 |
+
122,28658,0.008481699042022228,
|
| 698 |
+
123,28699,,0.0071630701422691345
|
| 699 |
+
123,28749,,0.005676476284861565
|
| 700 |
+
123,28799,,0.008322194218635559
|
| 701 |
+
123,28849,,0.006588925141841173
|
| 702 |
+
123,28891,0.008385318331420422,
|
| 703 |
+
124,28899,,0.006715129129588604
|
| 704 |
+
124,28949,,0.0046298266388475895
|
| 705 |
+
124,28999,,0.0045791976153850555
|
| 706 |
+
124,29049,,0.005021781660616398
|
| 707 |
+
124,29099,,0.015924064442515373
|
| 708 |
+
124,29124,0.008418125100433826,
|
| 709 |
+
125,29149,,0.008916601538658142
|
| 710 |
+
125,29199,,0.006212690379470587
|
| 711 |
+
125,29249,,0.005429331678897142
|
| 712 |
+
125,29299,,0.007248596753925085
|
| 713 |
+
125,29349,,0.007207055110484362
|
| 714 |
+
125,29357,0.008279496803879738,
|
| 715 |
+
126,29399,,0.006323528476059437
|
| 716 |
+
126,29449,,0.006716982461512089
|
| 717 |
+
126,29499,,0.005460174288600683
|
| 718 |
+
126,29549,,0.004798295442014933
|
| 719 |
+
126,29590,0.00802029762417078,
|
| 720 |
+
127,29599,,0.010112179443240166
|
| 721 |
+
127,29649,,0.0054520536214113235
|
| 722 |
+
127,29699,,0.008057708851993084
|
| 723 |
+
127,29749,,0.005594226997345686
|
| 724 |
+
127,29799,,0.009124589152634144
|
| 725 |
+
127,29823,0.00787987932562828,
|
| 726 |
+
128,29849,,0.006573852617293596
|
| 727 |
+
128,29899,,0.005986103322356939
|
| 728 |
+
128,29949,,0.00629796739667654
|
| 729 |
+
128,29999,,0.006925624329596758
|
| 730 |
+
128,30049,,0.028203174471855164
|
| 731 |
+
128,30056,0.008218895643949509,
|
| 732 |
+
129,30099,,0.005303604528307915
|
| 733 |
+
129,30149,,0.00823366828262806
|
| 734 |
+
129,30199,,0.008076443336904049
|
| 735 |
+
129,30249,,0.005666161887347698
|
| 736 |
+
129,30289,0.008095948025584221,
|
| 737 |
+
130,30299,,0.006363274063915014
|
| 738 |
+
130,30349,,0.010425647720694542
|
| 739 |
+
130,30399,,0.006245138123631477
|
| 740 |
+
130,30449,,0.01085128914564848
|
| 741 |
+
130,30499,,0.008620311506092548
|
| 742 |
+
130,30522,0.008161315694451332,
|
| 743 |
+
131,30549,,0.008366824127733707
|
| 744 |
+
131,30599,,0.009563595987856388
|
| 745 |
+
131,30649,,0.010114502161741257
|
| 746 |
+
131,30699,,0.006071112584322691
|
| 747 |
+
131,30749,,0.005452034529298544
|
| 748 |
+
131,30755,0.007972240447998047,
|
| 749 |
+
132,30799,,0.00525331636890769
|
| 750 |
+
132,30849,,0.010969644412398338
|
| 751 |
+
132,30899,,0.007480324245989323
|
| 752 |
+
132,30949,,0.006384207401424646
|
| 753 |
+
132,30988,0.008127872832119465,
|
| 754 |
+
133,30999,,0.006873930338770151
|
| 755 |
+
133,31049,,0.00931630190461874
|
| 756 |
+
133,31099,,0.0074219233356416225
|
| 757 |
+
133,31149,,0.006929187104105949
|
| 758 |
+
133,31199,,0.007220882922410965
|
| 759 |
+
133,31221,0.008026429452002048,
|
| 760 |
+
134,31249,,0.00726038683205843
|
| 761 |
+
134,31299,,0.016322379931807518
|
| 762 |
+
134,31349,,0.006356596015393734
|
| 763 |
+
134,31399,,0.005578037817031145
|
| 764 |
+
134,31449,,0.008413984440267086
|
| 765 |
+
134,31454,0.008534874767065048,
|
| 766 |
+
135,31499,,0.013690531253814697
|
| 767 |
+
135,31549,,0.006001586560159922
|
| 768 |
+
135,31599,,0.00640503317117691
|
| 769 |
+
135,31649,,0.011542258784174919
|
| 770 |
+
135,31687,0.008443756029009819,
|
| 771 |
+
136,31699,,0.0067335874773561954
|
| 772 |
+
136,31749,,0.005280566867440939
|
| 773 |
+
136,31799,,0.005492171738296747
|
| 774 |
+
136,31849,,0.0069390395656228065
|
| 775 |
+
136,31899,,0.008835828863084316
|
| 776 |
+
136,31920,0.008214224129915237,
|
| 777 |
+
137,31949,,0.01806776411831379
|
| 778 |
+
137,31999,,0.005667026620358229
|
| 779 |
+
137,32049,,0.0061721461825072765
|
| 780 |
+
137,32099,,0.005701934453099966
|
| 781 |
+
137,32149,,0.012365772388875484
|
| 782 |
+
137,32153,0.008296037092804909,
|
| 783 |
+
138,32199,,0.008139712736010551
|
| 784 |
+
138,32249,,0.005744713358581066
|
| 785 |
+
138,32299,,0.008589616045355797
|
| 786 |
+
138,32349,,0.007126661483198404
|
| 787 |
+
138,32386,0.008309477008879185,
|
| 788 |
+
139,32399,,0.0070837922394275665
|
| 789 |
+
139,32449,,0.004870944656431675
|
| 790 |
+
139,32499,,0.007155123632401228
|
| 791 |
+
139,32549,,0.006377063225954771
|
| 792 |
+
139,32599,,0.006050293333828449
|
| 793 |
+
139,32619,0.008268756791949272,
|
| 794 |
+
140,32649,,0.008555719628930092
|
| 795 |
+
140,32699,,0.008807959035038948
|
| 796 |
+
140,32749,,0.008072678931057453
|
| 797 |
+
140,32799,,0.008286567404866219
|
| 798 |
+
140,32849,,0.013317829929292202
|
| 799 |
+
140,32852,0.008409185335040092,
|
anvil_training/model.json
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"n_tasks": 5,
|
| 3 |
+
"ffn_hidden_dim": 512,
|
| 4 |
+
"batch_norm": false,
|
| 5 |
+
"dropout": 0.25,
|
| 6 |
+
"from_chemeleon": true,
|
| 7 |
+
"scheduler": "plateau",
|
| 8 |
+
"mpnn_lr": 0.0001,
|
| 9 |
+
"ffn_lr": 0.001,
|
| 10 |
+
"mpnn_weight_decay": 0.0,
|
| 11 |
+
"ffn_weight_decay": 0.0001,
|
| 12 |
+
"reduce_lr_factor": 0.5,
|
| 13 |
+
"reduce_lr_patience": 5
|
| 14 |
+
}
|
anvil_training/model.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23a9b6fbb9c1db81555835eaf4ee78b485fb1a9c6d1deef689ab95998efe2c2b
|
| 3 |
+
size 39069388
|
anvil_training/recipe_components/data.yaml
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
anvil_dir: file:///home/ec2-user/permeability_models/multitask/all_endpoints_model
|
| 2 |
+
cat_entry: null
|
| 3 |
+
dropna: false
|
| 4 |
+
input_col: OPENADMET_CANONICAL_SMILES
|
| 5 |
+
resource: ../../ChEMBL35_Caco2_permeability_multitask_atob_btoa_logD_mppb_rescaled.parquet
|
| 6 |
+
target_cols:
|
| 7 |
+
- logD
|
| 8 |
+
- caco2_atob_LogPapp
|
| 9 |
+
- caco2_btoa_LogPapp
|
| 10 |
+
- mppb_LogUnbound
|
| 11 |
+
- hppb_LogUnbound
|
| 12 |
+
test_resource: null
|
| 13 |
+
train_resource: null
|
| 14 |
+
type: intake
|
| 15 |
+
val_resource: null
|
anvil_training/recipe_components/eval.yaml
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
eval:
|
| 2 |
+
- params: {}
|
| 3 |
+
type: RegressionMetrics
|
| 4 |
+
- params:
|
| 5 |
+
axes_labels:
|
| 6 |
+
- True LogPapp
|
| 7 |
+
- Predicted LogPapp
|
| 8 |
+
n_repeats: 5
|
| 9 |
+
n_splits: 5
|
| 10 |
+
pXC50: true
|
| 11 |
+
random_state: 42
|
| 12 |
+
title: Multitask True vs Predicted LogPapp on test set
|
| 13 |
+
type: PytorchLightningRepeatedKFoldCrossValidation
|
anvil_training/recipe_components/metadata.yaml
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
authors: Maria A. Castellanos
|
| 2 |
+
biotargets:
|
| 3 |
+
- Caco-2
|
| 4 |
+
build_number: 0
|
| 5 |
+
description: basic regression using a ChemProp multitask task model
|
| 6 |
+
driver: pytorch
|
| 7 |
+
email: maria.castellanos@omsf.io
|
| 8 |
+
name: chemprop_pchembl
|
| 9 |
+
tag: chemprop
|
| 10 |
+
tags:
|
| 11 |
+
- openadmet
|
| 12 |
+
- example
|
| 13 |
+
- chemprop
|
| 14 |
+
version: v1
|
anvil_training/recipe_components/procedure.yaml
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
ensemble: null
|
| 2 |
+
feat:
|
| 3 |
+
params:
|
| 4 |
+
batch_size: 128
|
| 5 |
+
n_jobs: 4
|
| 6 |
+
normalize_targets: true
|
| 7 |
+
type: ChemPropFeaturizer
|
| 8 |
+
model:
|
| 9 |
+
freeze_weights: null
|
| 10 |
+
param_path: null
|
| 11 |
+
params:
|
| 12 |
+
batch_norm: false
|
| 13 |
+
dropout: 0.25
|
| 14 |
+
ffn_hidden_dim: 512
|
| 15 |
+
ffn_hidden_num_layers: 3
|
| 16 |
+
ffn_lr: 1e-3
|
| 17 |
+
ffn_weight_decay: 1e-4
|
| 18 |
+
from_chemeleon: true
|
| 19 |
+
mpnn_lr: 1e-4
|
| 20 |
+
mpnn_weight_decay: 0
|
| 21 |
+
n_tasks: 5
|
| 22 |
+
reduce_lr_factor: 0.5
|
| 23 |
+
reduce_lr_patience: 5
|
| 24 |
+
scheduler: plateau
|
| 25 |
+
serial_path: null
|
| 26 |
+
type: ChemPropModel
|
| 27 |
+
split:
|
| 28 |
+
params:
|
| 29 |
+
random_state: 42
|
| 30 |
+
test_size: 0.0
|
| 31 |
+
train_size: 1.0
|
| 32 |
+
val_size: 0.0
|
| 33 |
+
type: ShuffleSplitter
|
| 34 |
+
train:
|
| 35 |
+
params:
|
| 36 |
+
accelerator: gpu
|
| 37 |
+
early_stopping: true
|
| 38 |
+
early_stopping_min_delta: 0.001
|
| 39 |
+
early_stopping_mode: min
|
| 40 |
+
early_stopping_patience: 20
|
| 41 |
+
gradient_clip_val: 0.5
|
| 42 |
+
max_epochs: 200
|
| 43 |
+
monitor_metric: val_loss
|
| 44 |
+
use_wandb: false
|
| 45 |
+
wandb_project: demos
|
| 46 |
+
type: LightningTrainer
|
| 47 |
+
transform: null
|
expansion_data_inference.csv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
meta.yaml
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
# just for Hugging Face download tracking purposes
|
run_model_inference.sh
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#!/bin/bash
|
| 2 |
+
# Script to run OpenADMET predictions in a standalone shell
|
| 3 |
+
|
| 4 |
+
# Exit immediately if a command exits with a non-zero status
|
| 5 |
+
set -e
|
| 6 |
+
|
| 7 |
+
# --- Environment variables ---
|
| 8 |
+
export TABPFN_TELEMETRY_OPTOUT=1
|
| 9 |
+
export OADMET_NO_RICH_LOGGING=1
|
| 10 |
+
|
| 11 |
+
openadmet predict \
|
| 12 |
+
--input-path expansion_data_inference.csv \
|
| 13 |
+
--input-col SMILES \
|
| 14 |
+
--model-dir anvil_training/ \
|
| 15 |
+
--output-csv predictions.csv \
|
| 16 |
+
--accelerator cpu
|