LSTM Hybrid Model with EasyHybrid.jl

This tutorial demonstrates how to use EasyHybrid to train a hybrid model with LSTM neural networks on synthetic data for respiration modeling with Q10 temperature sensitivity. The code for this tutorial can be found in docs/src/literate/tutorials => example_synthetic_lstm.jl.

1. Load Packages

Set project path and activate environment

using EasyHybrid
using AxisKeys
using DimensionalData

2. Data Loading and Preprocessing

Load synthetic dataset from GitHub - it's tabular data

df = load_timeseries_netcdf("https://github.com/bask0/q10hybrid/raw/master/data/Synthetic4BookChap.nc");

Select a subset of data for faster execution

df = df[1:20000, :];
first(df, 5);

3. Define Neural Network Architectures

Define a standard feedforward neural network

NN = Chain(Dense(15, 15, Lux.sigmoid), Dense(15, 15, Lux.sigmoid), Dense(15, 1))

Chain(
    layer_(1-2) = Dense(15 => 15, σ),             # 480 (240 x 2) parameters
    layer_3 = Dense(15 => 1),                     # 16 parameters
)         # Total: 496 parameters,
          #        plus 0 states.

Define LSTM-based neural network with memory

TIP

When the Chain ends with a Recurrence layer, EasyHybrid automatically adds a RecurrenceOutputDense layer to handle the sequence output format. The user only needs to define the Recurrence layer itself!

NN_Memory = Chain(
    Recurrence(LSTMCell(15 => 15), return_sequence = true),
)

Chain(
    layer_1 = Recurrence(
        cell = LSTMCell(15 => 15),                # 1_920 parameters, plus 1 non-trainable
    ),
)         # Total: 1_920 parameters,
          #        plus 1 states.

4. We define the process-based model, a classical Q10 model for respiration

"""
    RbQ10(; ta, Q10, rb, tref=15.0f0)

Respiration model with Q10 temperature sensitivity.

- `ta`: air temperature [°C]
- `Q10`: temperature sensitivity factor [-]
- `rb`: basal respiration rate [μmol/m²/s]
- `tref`: reference temperature [°C] (default: 15.0)
"""
function RbQ10(; ta, Q10, rb, tref = 15.0f0)
    reco = rb .* Q10 .^ (0.1f0 .* (ta .- tref))
    return (; reco, Q10, rb)
end

5. Define Model Parameters

Parameter specification: (default, lower_bound, upper_bound)

parameters = (
    rb = (3.0f0, 0.0f0, 13.0f0),  # Basal respiration [μmol/m²/s]
    Q10 = (2.0f0, 1.0f0, 4.0f0),   # Temperature sensitivity factor [-]
)

(rb = (3.0f0, 0.0f0, 13.0f0), Q10 = (2.0f0, 1.0f0, 4.0f0))

6. Configure Hybrid Model Components

Define input variables Forcing variables (temperature)

forcing = [:ta]

1-element Vector{Symbol}:
 :ta

Predictor variables (solar radiation, and its derivative)

predictors = [:sw_pot, :dsw_pot]

2-element Vector{Symbol}:
 :sw_pot
 :dsw_pot

Target variable (respiration)

target = [:reco]

1-element Vector{Symbol}:
 :reco

Parameter classification Global parameters (same for all samples)

global_param_names = [:Q10]

1-element Vector{Symbol}:
 :Q10

Neural network predicted parameters

neural_param_names = [:rb]

1-element Vector{Symbol}:
 :rb

7. Construct LSTM Hybrid Model

Create LSTM hybrid model using the unified constructor

hlstm = constructHybridModel(
    predictors,
    forcing,
    target,
    RbQ10,
    parameters,
    neural_param_names,
    global_param_names,
    hidden_layers = NN_Memory, # Neural network architecture
    scale_nn_outputs = true, # Scale neural network outputs
    input_batchnorm = false   # Apply batch normalization to inputs
)

Hybrid Model (Single NN)
Neural Network: 
  Chain(
      layer_1 = WrappedFunction(identity),
      layer_2 = Dense(2 => 15, tanh),               # 45 parameters
      layer_3 = Recurrence(
          cell = LSTMCell(15 => 15),                # 1_920 parameters, plus 1 non-trainable
      ),
      layer_4 = RecurrenceOutputDense(
          layer = Dense(15 => 15, tanh),            # 240 parameters
      ),
      layer_5 = Dense(15 => 1),                     # 16 parameters
  )         # Total: 2_221 parameters,
            #        plus 1 states.
Configuration:
  predictors = [:sw_pot, :dsw_pot]
  forcing = [:ta]
  targets = [:reco]
  mechanistic_model = RbQ10
  neural_param_names = [:rb]
  global_param_names = [:Q10]
  fixed_param_names = Symbol[]
  scale_nn_outputs = true
  start_from_default = true
  config = (; hidden_layers = Chain{@NamedTuple{layer_1::Recurrence{Static.True, LSTMCell{Static.False, Static.False, Int64, Int64, NTuple{4, Nothing}, NTuple{4, Nothing}, NTuple{4, Nothing}, typeof(WeightInitializers.zeros32), typeof(WeightInitializers.zeros32), Static.True}, Lux.BatchLastIndex}}, Nothing}((layer_1 = Recurrence{Static.True, LSTMCell{Static.False, Static.False, Int64, Int64, NTuple{4, Nothing}, NTuple{4, Nothing}, NTuple{4, Nothing}, typeof(WeightInitializers.zeros32), typeof(WeightInitializers.zeros32), Static.True}, Lux.BatchLastIndex}(LSTMCell(15 => 15), Lux.BatchLastIndex(), static(true), false, false),), nothing), activation = tanh, scale_nn_outputs = true, input_batchnorm = false, start_from_default = true,)

Parameters:
  Hybrid Parameters
    ┌─────┬─────────┬───────┬───────┐
    │     │ default │ lower │ upper │
    ├─────┼─────────┼───────┼───────┤
    │  rb │     3.0 │   0.0 │  13.0 │
    │ Q10 │     2.0 │   1.0 │   4.0 │
    └─────┴─────────┴───────┴───────┘

8. Data Preparation Steps (Demonstration)

The following steps demonstrate what happens under the hood during training. In practice, you can skip to Section 9 and use the train function directly.

:KeyedArray and :DimArray are supported

pref_array_type = :DimArray
x, y = prepare_data(hlstm, df, array_type = pref_array_type);

Convert a (single) time series into many training samples by windowing.

Each sample consists of:

• input_window: number of past steps given to the model (sequence length)

• output_window: number of steps to predict

• output_shift: stride between consecutive windows (controls overlap)

• lead_time: prediction lead (e.g. lead_time=1 predicts starting 1 step ahead)

This supports many-to-one / many-to-many forecasting depending on output_window. Creates an array of shape (variable, time, batch_size) with variable being feature, time the input window, andbatch_size1:n samples (= full batch)

output_shift = 1
output_window = 1
input_window = 10
(xs, forcings_s), ys = split_into_sequences(x, y; input_window = input_window, output_window = output_window, output_shift = output_shift, lead_time = 0);

First input_window/sample

xs[:, :, 1]

┌ 2×10 DimArray{Float32, 2} ┐
├───────────────────────────┴─────────────────────────────────────── dims ┐
  ↓ variable Categorical{Symbol} [:sw_pot, :dsw_pot] Unordered,
  → time Categorical{Symbol} [:x9_to_x9, …, :x9_to_x0_y0] ReverseOrdered
└─────────────────────────────────────────────────────────────────────────┘
 ↓ →           :x9_to_x9     :x9_to_x8  …     :x9_to_x1     :x9_to_x0_y0
  :sw_pot   109.817       109.817          109.817       109.817
  :dsw_pot  115.595       115.595          115.595       115.595

Second input_window/sample

xs[:, :, 2]

┌ 2×10 DimArray{Float32, 2} ┐
├───────────────────────────┴─────────────────────────────────────── dims ┐
  ↓ variable Categorical{Symbol} [:sw_pot, :dsw_pot] Unordered,
  → time Categorical{Symbol} [:x9_to_x9, …, :x9_to_x0_y0] ReverseOrdered
└─────────────────────────────────────────────────────────────────────────┘
 ↓ →           :x9_to_x9     :x9_to_x8  …     :x9_to_x1     :x9_to_x0_y0
  :sw_pot   109.817       109.817          109.817       109.817
  :dsw_pot  115.595       115.595          115.595       115.595

test of shift

xs[:, output_shift + 1, 1] == xs[:, 1, 2]

true

First output_window/sample with time label like :x30_to_x5_y4 which indicates an accumulation of memory from x30 to x5 for the prediction of y4

ys.reco

┌ 1×19991 DimArray{Float32, 2} ┐
├──────────────────────────────┴─────────────────────────────────────── dims ┐
  ↓ time Categorical{Symbol} [:x9_to_x0_y0] ForwardOrdered,
  → batch_size Sampled{Int64} [1, …, 19991] ForwardOrdered Irregular Points
└────────────────────────────────────────────────────────────────────────────┘
 ↓ →            1         2         3         …  19990         19991
  :x9_to_x0_y0  0.806911  0.803646  0.794573         0.211483      0.211106

Second output_window/sample

ys.reco[:, 2]

forcings_s.ta

10×19991 Matrix{Float32}:
 2.1   1.98  1.89  2.06  2.09   1.75  …  10.7   11.11  11.26  10.29   9.68
 1.98  1.89  2.06  2.09  1.75   1.51     11.11  11.26  10.29   9.68   9.22
 1.89  2.06  2.09  1.75  1.51   1.36     11.26  10.29   9.68   9.22   9.63
 2.06  2.09  1.75  1.51  1.36   1.11     10.29   9.68   9.22   9.63   9.93
 2.09  1.75  1.51  1.36  1.11   0.97      9.68   9.22   9.63   9.93  11.11
 1.75  1.51  1.36  1.11  0.97   0.87  …   9.22   9.63   9.93  11.11  11.06
 1.51  1.36  1.11  0.97  0.87   0.59      9.63   9.93  11.11  11.06  10.96
 1.36  1.11  0.97  0.87  0.59   0.23      9.93  11.11  11.06  10.96  10.55
 1.11  0.97  0.87  0.59  0.23   0.06     11.11  11.06  10.96  10.55  11.06
 0.97  0.87  0.59  0.23  0.06  -0.23     11.06  10.96  10.55  11.06  10.91

Any of the first output_window the same as the second output_window? ideally not big overlap

overlap = output_window - output_shift
overlap_length = sum(in(ys.reco[:, 1]), ys.reco[:, 2])

0

Split the (windowed) dataset into train/validation in the same way as train does.

sdf = split_data(df, hlstm, sequence_kwargs = (; input_window = input_window, output_window = output_window, output_shift = output_shift, lead_time = 0), array_type = pref_array_type);

((x_train, f_train), y_train), ((x_val, f_val), y_val) = sdf;
x_train
y_train
f_train
y_train_nan = map(v -> .!isnan.(v), y_train)

(reco = Bool[1 1 … 1 1],)

Wrap the training windows/samples in a DataLoader to form batches.

WARNING

batchsize is the number of windows/samples used per gradient step to update the parameters. Processing 32 windows in one array is usually much faster than doing 32 separate forward/backward passes with batch_size=1.

train_dl = EasyHybrid.DataLoader(((x_train, f_train), y_train); batchsize = 32);

Run hybrid model forwards

(x_first, forcings_first), y_first = first(train_dl)

ps, st = Lux.setup(Random.default_rng(), hlstm);
xf = (x_first, forcings_first)
frun = hlstm(xf, ps, st);

┌ Warning: `replicate` doesn't work for `TaskLocalRNG`. Returning the same `TaskLocalRNG`.
└ @ LuxCore ~/.julia/packages/LuxCore/kQC9S/src/LuxCore.jl:18
┌ Warning: `replicate` doesn't work for `TaskLocalRNG`. Returning the same `TaskLocalRNG`.
└ @ LuxCore ~/.julia/packages/LuxCore/kQC9S/src/LuxCore.jl:18

Extract predicted yhat

reco_mod = frun[1].reco

10×32 Matrix{Float32}:
 3.51847  3.48933  3.46763  3.50873  …  3.8263   3.86629  3.79197  3.75796
 3.75827  3.7349   3.77917  3.78704     4.16429  4.08424  4.04761  3.80282
 3.80997  3.85513  3.86316  3.77318     4.16634  4.12896  3.87926  3.88195
 3.88699  3.89508  3.80436  3.7416      4.16309  3.91132  3.91403  3.84412
 3.90866  3.81762  3.75464  3.7158      3.92495  3.92767  3.85752  3.74165
 3.82216  3.7591   3.72022  3.65631  …  3.93234  3.86211  3.7461   3.66646
 3.75994  3.72105  3.65712  3.6218      3.86296  3.74693  3.66727  3.70047
 3.72041  3.65649  3.62118  3.59617     3.74628  3.66664  3.69983  3.63627
 3.65534  3.62004  3.59504  3.52594     3.66549  3.69867  3.63513  3.71666
 3.61875  3.59376  3.52468  3.43782     3.69735  3.63383  3.71533  3.71276

Bring observations in same shape

reco_obs = y_first.reco
reco_nan = .!isnan.(reco_obs);

Compute loss

EasyHybrid.compute_loss(hlstm, ps, st, ((x_train, f_train), (y_train, y_train_nan)), logging = LoggingLoss(train_mode = true))

(21.427757f0, (st_nn = (layer_1 = NamedTuple(), layer_2 = NamedTuple(), layer_3 = (rng = TaskLocalRNG(),), layer_4 = NamedTuple(), layer_5 = NamedTuple()), fixed = NamedTuple()), NamedTuple())

9. Train LSTM Hybrid Model

out_lstm = train(
    hlstm,
    df,
    ();
    nepochs = 100,           # Number of training epochs
    batchsize = 128,         # Batch size of training windows/samples
    opt = RMSProp(0.01),   # Optimizer and learning rate
    monitor_names = [:rb, :Q10], # Parameters to monitor during training
    yscale = identity,       # Scaling for outputs
    shuffleobs = true,
    training_loss = :nseLoss,
    loss_types = [:nse],
    sequence_kwargs = (; input_window = input_window, output_window = output_window, output_shift = output_shift, lead_time = 0),
    plotting = false,
    show_progress = false,
    input_batchnorm = false,
    array_type = pref_array_type,
    model_name = "RbQ10_synthetic_lstm"
);

out_lstm.val_obs_pred

3998×2 DataFrame

Row	reco	reco_pred
	Float32	Float32
1	2.5595	2.6544
2	0.0883865	0.192392
3	0.143945	0.229465
4	6.17557	5.57149
5	1.35721	2.22584
6	0.474447	0.422802
7	0.587843	0.574191
8	1.01569	1.27391
9	1.0864	1.22411
10	0.25203	0.256611
11	1.64938	2.5452
12	0.708175	0.509463
13	5.46109	4.75635
14	1.52933	2.36526
15	0.761054	0.929934
16	0.180138	0.293548
17	4.24323	3.81061
18	11.0577	11.7245
19	0.122991	0.272556
20	4.94579	5.48223
21	7.52149	7.58824
22	0.311074	0.604823
23	0.386997	0.259402
24	0.322162	0.206464
25	0.432646	0.29889
26	0.356429	0.271855
27	0.554456	0.323572
28	0.619946	0.666386
29	0.280599	0.430245
30	8.35232	8.14497
31	4.30958	3.6818
32	0.299264	0.229347
33	0.370049	0.270862
34	1.22604	1.73718
35	3.51427	3.4291
36	1.27674	1.16912
37	3.33567	2.91987
38	3.6654	2.8736
39	1.01221	1.4309
40	1.03082	1.92537
41	3.88568	3.45675
42	2.40112	3.21852
43	0.1209	0.278375
44	4.80263	4.16858
45	4.57311	3.93281
46	2.43894	2.62043
47	4.48536	3.8506
48	0.400345	0.223883
49	4.28481	4.20913
50	0.253828	0.273259
51	0.664953	0.743047
52	0.28149	0.278375
53	1.07996	0.886075
54	0.557372	0.378051
55	1.36441	1.91299
56	1.00808	1.30111
57	1.94491	1.61961
58	1.12937	1.65528
59	3.15673	2.90337
60	0.53832	0.537544
61	0.995103	1.16768
62	1.52325	2.46982
63	4.44935	4.38164
64	9.39247	9.46739
65	1.35057	2.02348
66	0.527264	0.471682
67	0.294981	0.572085
68	0.746641	0.85066
69	1.21559	0.80593
70	0.389814	0.268058
71	6.22444	6.26954
72	2.97975	3.17569
73	1.85906	2.45951
74	2.34392	2.19593
75	4.09437	3.54771
76	0.444986	0.376655
77	5.55028	5.35639
78	0.133397	0.295064
79	0.132857	0.293548
80	6.96112	6.99191
81	0.390098	0.379026
82	0.926911	0.704472
83	0.122908	0.239491
84	0.164664	0.267547
85	3.06647	3.21852
86	1.92067	2.61369
87	2.40521	2.09319
88	4.76423	4.87043
89	4.71119	3.95312
90	4.61998	3.86053
91	1.85906	2.45951
92	2.6443	2.77609
93	2.6282	2.4955
94	3.80841	3.0131
95	0.174283	0.238998
96	0.514118	0.394366
97	4.79723	4.17934
98	1.95494	1.70586
99	0.492107	0.338407
100	3.24325	5.24284
101	0.196004	0.245741
102	5.5036	4.80562
103	2.24865	1.75128
104	6.58868	6.58035
105	4.46156	3.95121
106	0.359477	0.274812
107	0.0988989	0.201732
108	5.25741	4.66832
109	0.129735	0.289492
110	6.28586	6.19136
111	3.34394	2.95012
112	0.562295	0.344743
113	7.97997	7.68825
114	0.105742	0.229347
115	1.80265	2.66953
116	6.67461	6.12555
117	5.34475	4.8579
118	3.84655	3.61215
119	8.11944	7.85239
120	0.237224	0.211852
121	0.16706	0.213936
122	1.05211	1.25934
123	0.302936	0.245235
124	0.339027	0.230413
125	2.01501	1.84944
126	0.397765	0.436048
127	0.71312	0.968746
128	6.18359	5.6758
129	0.177809	0.376301
130	0.229372	0.378051
131	1.63453	1.34085
132	3.97601	3.51134
133	0.803452	0.644062
134	0.909567	0.764667
135	9.38613	9.64336
136	1.33392	1.13634
137	0.270986	0.266172
138	6.76868	7.56541
139	0.348461	0.240604
140	0.149802	0.35575
141	5.47573	5.38449
142	0.409326	0.228698
143	5.14174	5.2152
144	4.1307	3.53687
145	0.475882	0.306216
146	1.4502	2.2636
147	0.473494	0.338407
148	4.65245	4.19681
149	0.188276	0.197922
150	0.543447	0.711828
151	0.138132	0.320255
152	2.29444	2.90337
153	3.26225	2.85884
154	7.10497	6.97126
155	0.637912	0.591945
156	0.626992	0.506584
157	0.137684	0.285935
158	5.40404	5.00011
159	6.65398	6.10978
160	0.870084	1.03291
161	0.155351	0.324407
162	0.308917	0.368246
163	1.08776	0.924314
164	0.314546	0.286968
165	0.468986	0.300588
166	0.804215	1.00672
167	5.79594	5.14648
168	1.21566	1.90666
169	0.150043	0.272135
170	1.36464	2.04645
171	0.339925	0.269651
172	1.64728	1.409
173	6.2075	5.69044
174	1.35135	0.977208
175	4.45492	3.97169
176	0.388221	0.268058
177	0.0869036	0.188954
178	0.271645	0.337536
179	0.470892	0.302141
180	4.34501	4.29888
181	2.49279	2.525
182	0.520473	0.651965
183	0.404391	0.226762
184	3.45236	3.27878
185	5.07355	4.37095
186	0.632835	0.634226
187	0.417078	0.299815
188	0.263386	0.303702
189	5.84447	5.17573
190	0.627573	0.400715
191	1.9201	2.18352
192	1.4865	1.35894
193	0.856169	0.994787
194	1.04161	1.35878
195	2.84403	2.91987
196	5.64653	5.65999
197	2.18027	2.8063
198	8.7304	8.84034
199	0.360806	0.292793
200	0.651032	1.01268
201	0.400286	0.572085
202	2.25349	1.93861
203	7.40093	7.40825
204	7.60042	7.74686
205	3.09169	3.06951
206	0.655239	0.506584
207	4.61058	4.07095
208	0.288888	0.273259
209	7.26439	6.91758
210	0.183209	0.347417
211	0.219819	0.309388
212	9.32604	9.8239
213	0.731941	0.465775
214	6.96032	6.45941
215	4.51509	4.09143
216	0.235884	0.230651
217	0.563901	0.36241
218	4.19041	3.82705
219	3.81941	3.66288
220	0.190551	0.394366
221	0.103712	0.221565
222	1.01348	1.30993
223	0.112197	0.197108
224	2.61616	2.525
225	6.04811	5.72157
226	5.26521	4.53615
227	2.38563	3.87061
228	5.80912	5.48055
229	0.206212	0.461951
230	0.22485	0.502683
231	0.67837	0.805929
232	5.75672	5.29917
233	0.443202	0.473063
234	7.56054	7.30967
235	0.116075	0.210438
236	1.04966	1.37215
237	2.33593	3.43795
238	2.91127	4.80565
239	0.175915	0.315993
240	6.38432	6.43966
241	6.07663	5.44099
242	0.519018	0.49297
243	1.76244	1.53486
244	6.8563	6.88203
245	2.85748	4.41622
246	0.46219	0.295064
247	1.53913	1.05765
248	5.91708	5.52786
249	0.16204	0.198638
250	10.2663	10.7468
251	0.184607	0.303702
252	2.80776	2.71413
253	4.07127	3.96273
254	4.40825	3.72185
255	3.8007	3.00535
256	1.14842	0.750614
257	6.01701	5.52859
258	4.59159	4.36102
259	6.25861	5.61686
260	0.108379	0.205297
261	0.119733	0.247776
262	0.197594	0.264804
263	0.36571	0.290299
264	1.8161	3.17962
265	0.122699	0.230769
266	4.37588	3.90201
267	0.423975	0.277416
268	2.95234	2.79187
269	9.02964	9.44303
270	0.827281	1.10705
271	2.08207	2.8959
272	0.451748	0.328782
273	5.77356	6.04586
274	0.32291	0.298121
275	4.54915	4.46367
276	0.240126	0.400715
277	1.27783	2.03141
278	0.104004	0.220995
279	0.106878	0.231246
280	1.60392	2.65854
281	0.175537	0.269762
282	4.98748	4.66667
283	0.559347	0.358695
284	7.46747	7.52753
285	2.30665	2.51202
286	7.4836	7.08256
287	0.258827	0.262089
288	5.824	5.35477
289	1.70266	3.0343
290	1.09592	1.46198
291	0.0950912	0.210329
292	2.35645	2.4081
293	1.98117	1.64882
294	3.80925	4.65692
295	0.806892	0.671857
296	1.38984	1.36244
297	0.21022	0.463382
298	0.104917	0.222709
299	1.20705	1.78669
300	0.0868341	0.17845
301	0.219016	0.254019
302	7.29174	7.13846
303	4.57388	4.30169
304	0.221688	0.306216
305	0.231505	0.194385
306	3.32083	2.90337
307	0.698687	0.650777
308	2.38224	3.02087
309	0.300388	0.544196
310	0.208192	0.252271
311	5.69102	5.93781
312	10.9261	11.6943
313	6.9416	6.47608
314	0.860926	0.948257
315	1.51985	1.14839
316	5.7697	5.35477
317	1.00383	0.89341
318	5.06457	5.0519
319	3.62179	3.34016
320	4.95844	4.21176
321	5.45058	4.81801
322	2.48496	5.03346
323	0.185745	0.274247
324	1.03047	1.21494
325	1.4456	1.16611
326	0.8105	1.34862
327	2.26585	2.05776
328	0.22969	0.26236
329	0.180168	0.222365
330	0.85418	1.15304
331	2.41237	3.06951
332	0.561619	0.360548
333	5.14985	4.57134
334	0.576916	0.673636
335	0.744603	0.615829
336	1.69541	1.52205
337	6.41561	6.07839
338	5.29594	5.18909
339	2.30822	2.34564
340	7.96421	7.66846
341	1.76979	2.80725
342	0.326072	0.269651
343	0.20853	0.252792
344	0.600817	0.731147
345	0.168579	0.277659
346	0.292834	0.244101
347	1.55752	2.52916
348	0.252093	0.290389
349	0.196023	0.345632
350	2.83787	2.76895
351	0.372655	0.22453
352	4.26034	3.73145
353	5.64775	4.97375
354	0.312712	0.310986
355	0.553024	0.337536
356	0.187138	0.276802
357	4.43139	4.3952
358	6.07842	5.54285
359	0.312636	0.269165
360	2.60158	2.66949
361	0.826347	0.748683
362	1.13749	0.946484
363	2.78639	2.72069
364	0.15603	0.254766
365	0.794573	0.98834
366	6.13332	5.58586
367	1.01915	1.26736
368	1.00414	1.2992
369	4.05984	3.61238
370	4.33851	3.99613
371	2.30348	2.2244
372	0.369374	0.270235
373	7.29918	7.66094
374	4.64884	4.24606
375	1.06871	1.07994
376	0.206296	0.264123
377	0.114263	0.201732
378	0.192285	0.459577
379	0.469606	0.312786
380	3.34244	2.9274
381	5.47489	5.0389
382	0.458396	0.496539
383	0.339925	0.269651
384	3.10524	3.23515
385	7.28676	6.86079
386	2.72882	2.48738
387	0.601769	0.366353
388	0.735533	1.00381
389	8.42245	8.23358
390	5.4232	5.00011
391	0.290956	0.386122
392	0.155575	0.244353
393	1.30586	1.83761
394	0.333907	0.430245
395	0.838085	1.12546
396	2.21912	1.81279
397	0.785401	0.78272
398	2.43089	2.72508
399	7.17184	6.80797
400	2.61537	2.4324
401	1.69294	1.31707
402	0.903607	1.06535
403	2.93381	2.88845
404	3.20779	2.94794
405	6.16666	5.57149
406	2.14142	2.90337
407	0.50427	0.626282
408	3.04124	2.6544
409	4.19883	3.70082
410	8.54604	8.38773
411	2.87387	2.85334
412	5.70917	4.94819
413	0.565831	0.365411
414	0.841616	0.944833
415	2.40077	2.16322
416	4.57148	4.16858
417	0.577815	0.666386
418	5.91052	5.85417
419	2.59432	2.34564
420	1.27344	1.77984
421	5.41514	5.31354
422	3.88128	3.47193
423	6.2286	6.56202
424	0.174515	0.152578
425	0.981461	1.2594
426	0.163438	0.256214
427	6.50937	5.96668
428	1.14253	1.67338
429	1.7371	1.47834
430	0.204198	0.377078
431	2.71821	2.76116
432	1.35212	0.990526
433	7.60287	7.32853
434	2.3988	2.26749
435	0.783649	0.651069
436	2.8494	2.78326
437	7.51355	7.94639
438	5.27799	5.07815
439	4.07035	3.77011
440	5.31879	5.34261
441	1.79869	1.6102
442	2.40112	3.21852
443	0.125166	0.245615
444	6.79165	6.3407
445	2.92484	2.53668
446	4.79646	5.18909
447	3.05614	2.59763
448	0.717846	0.809156
449	2.39805	2.03714
450	0.94764	1.31562
451	1.36569	2.21052
452	4.25489	4.51051
453	4.37698	4.02867
454	2.37482	3.63469
455	3.90055	3.39936
456	0.872754	0.882446
457	5.61638	5.02594
458	7.16208	6.95332
459	0.808466	0.668404
460	9.50526	10.0078
461	0.208173	0.169838
462	7.79221	8.12648
463	2.89804	2.78326
464	6.95786	6.97392
465	8.37979	8.23358
466	4.94	5.05128
467	0.431747	0.283894
468	5.47023	4.76862
469	1.50648	1.17203
470	3.1737	2.56813
471	8.89462	9.26949
472	0.517218	0.668459
473	0.643183	0.647433
474	0.583163	0.617459
475	0.12388	0.293548
476	0.388992	0.268058
477	1.10693	1.46796
478	4.19684	4.06047
479	4.07781	3.52948
480	0.47722	0.500907
481	0.312597	0.269651
482	6.72255	6.82814
483	6.18551	6.25633
484	0.123447	0.282857
485	4.61477	3.8506
486	0.23073	0.25628
487	0.632128	0.594972
488	0.214181	0.346524
489	3.53295	3.2251
490	0.266176	0.245235
491	3.43798	3.21024
492	9.53295	9.69446
493	0.119732	0.274105
494	0.627992	0.708159
495	3.03972	3.10931
496	8.08566	7.83114
497	2.44418	3.77012
498	4.868	4.14716
499	0.224031	0.220312
500	0.766725	1.2895
501	9.02082	9.17323
502	1.28544	2.07735
503	0.429284	0.310986
504	4.87833	4.20093
505	0.310869	0.607947
506	3.8205	5.12003
507	2.86789	2.35395
508	0.563558	0.56977
509	0.568959	0.558435
510	2.15274	3.83509
511	0.339063	0.291558
512	0.710882	0.448813
513	4.50327	4.40654
514	5.30591	4.58313
515	0.42632	0.279367
516	0.238164	0.252012
517	0.103383	0.22548
518	2.33608	1.68403
519	5.97657	5.52786
520	0.580451	0.342971
521	3.92496	4.09198
522	5.70625	5.24484
523	0.282357	0.313561
524	1.46854	2.30005
525	1.69139	2.62782
526	0.32744	0.468182
527	2.33825	2.03575
528	3.64983	2.86621
529	0.119572	0.213716
530	0.496887	0.622101
531	2.68988	2.43223
532	11.1425	11.944
533	0.814261	0.817999
534	4.38372	3.8506
535	10.1466	10.4411
536	0.959561	1.77478
537	0.688534	0.56302
538	0.684187	0.76664
539	0.372744	0.273372
540	0.478564	0.498076
541	7.08447	6.88203
542	0.258829	0.250213
543	9.07305	9.15085
544	0.159045	0.32963
545	1.79155	3.0053
546	0.148906	0.343856
547	5.84389	5.32725
548	2.96184	2.57753
549	0.768902	0.637459
550	3.05792	2.77405
551	0.0925656	0.17436
552	0.193524	0.524377
553	5.07396	4.3373
554	0.193714	0.146794
555	1.79682	2.04627
556	0.302684	0.288747
557	0.499625	0.596518
558	0.103444	0.185768
559	0.197828	0.297047
560	3.54294	3.38043
561	2.33647	2.38218
562	10.1749	10.8903
563	0.110533	0.237403
564	0.257916	0.319266
565	2.24945	2.58556
566	0.315057	0.28756
567	0.248837	0.251765
568	7.31571	7.52653
569	0.747901	0.659554
570	1.21162	0.900342
571	0.148891	0.269484
572	3.00709	3.38347
573	6.23684	5.61471
574	5.10705	5.12199
575	0.280122	0.262765
576	3.57386	3.17569
577	4.57484	4.51039
578	0.401796	0.294305
579	1.78254	1.45146
580	1.04441	1.18652
581	0.21733	0.353011
582	0.320549	0.25967
583	0.184871	0.412233
584	4.85019	4.19012
585	3.76747	3.83981
586	0.192305	0.302921
587	5.57891	4.94885
588	0.768497	0.682721
589	2.11885	3.34891
590	0.897838	0.727014
591	0.117919	0.266859
592	6.73605	6.19219
593	0.176955	0.257803
594	0.950875	0.680918
595	9.84634	10.1651
596	0.759987	0.76941
597	2.90802	2.51716
598	0.144011	0.282857
599	0.615593	0.734923
600	3.07121	2.96536
601	0.350673	0.268182
602	1.15652	1.78957
603	0.656369	0.706337
604	3.60116	2.81353
605	0.290346	0.23268
606	3.96118	3.16752
607	0.305443	0.28068
608	0.963742	0.998154
609	5.26458	4.93546
610	6.88405	6.77298
611	4.61777	4.12372
612	1.73817	1.45254
613	0.815325	1.33823
614	5.48135	4.96161
615	0.38304	0.307006
616	0.22357	0.272556
617	1.97507	1.76847
618	0.579547	0.590391
619	1.7844	2.02738
620	0.251562	0.19549
621	4.89774	5.41199
622	0.435534	0.238089
623	0.179994	0.263443
624	3.5058	2.9274
625	6.979	6.61346
626	5.66686	4.98724
627	3.18049	2.95773
628	0.217984	0.332359
629	0.496126	0.573245
630	3.18953	2.96536
631	5.07971	4.34848
632	4.36371	4.0103
633	0.78466	1.06838
634	1.11142	1.47555
635	0.388715	0.277444
636	5.4258	5.05383
637	4.83512	4.91772
638	7.4141	7.00727
639	0.213271	0.275521
640	2.88174	2.79908
641	4.08344	4.11311
642	0.589715	0.714021
643	0.824008	0.742536
644	5.68184	5.0545
645	0.249309	0.248159
646	0.11496	0.203297
647	1.90078	3.274
648	0.182056	0.37206
649	3.68075	3.70082
650	0.778071	0.79275
651	5.01017	4.41791
652	5.15159	4.63201
653	4.73347	4.30333
654	4.7132	4.1806
655	4.9176	4.20093
656	8.53152	8.61106
657	0.637533	0.601445
658	2.33608	1.68403
659	3.96471	3.40105
660	2.55722	2.49197
661	0.914535	0.793159
662	4.17933	3.74108
663	3.94339	3.16752
664	1.62192	2.60952
665	4.29876	3.97559
666	1.20981	1.15713
667	0.183603	0.265624
668	5.36615	5.06754
669	2.49419	2.38833
670	0.0963708	0.203716
671	0.109931	0.244101
672	0.625419	0.706337
673	1.03863	1.95133
674	0.163732	0.299198
675	6.83353	6.79251
676	0.262547	0.466977
677	0.211483	0.558686
678	0.874368	1.19354
679	2.81085	2.57227
680	1.10083	1.44069
681	3.26697	5.41303
682	6.64443	6.71941
683	4.09653	3.74221
684	2.02773	2.30253
685	6.38266	5.78206
686	0.740616	0.715863
687	5.28687	4.78092
688	0.372015	0.274812
689	0.468054	0.517654
690	2.17089	2.03233
691	0.620395	0.626754
692	0.110682	0.232081
693	4.71699	4.47519
694	1.47653	2.20863
695	8.93237	9.31737
696	4.44422	3.88247
697	1.43686	2.29321
698	3.82542	3.56788
699	4.59533	4.01677
700	1.03446	1.19263
701	2.28865	2.3204
702	5.92313	5.49945
703	0.1854	0.304485
704	2.65476	2.79187
705	0.111492	0.234244
706	0.378637	0.291513
707	1.90374	2.19593
708	0.56074	0.317628
709	0.177503	0.303702
710	5.09026	4.33672
711	2.47105	1.94028
712	0.623515	0.397425
713	6.13934	5.67504
714	2.64484	3.12698
715	0.612701	0.647433
716	4.90365	4.66894
717	2.30995	2.0097
718	0.366376	0.28213
719	0.256385	0.390322
720	1.2024	2.14806
721	4.47679	4.33503
722	2.70621	2.43304
723	0.164484	0.291138
724	2.24674	1.9314
725	3.82304	3.48767
726	3.09704	4.06047
727	0.206376	0.295825
728	0.543447	0.711746
729	2.31518	2.16671
730	4.35142	4.14661
731	8.53004	8.81642
732	5.10316	4.96161
733	6.3533	5.74938
734	0.368695	0.221405
735	3.59255	3.45473
736	6.85804	6.52882
737	6.81557	6.42291
738	0.411934	0.300588
739	0.486254	0.560135
740	1.80468	1.70035
741	4.60182	4.27958
742	3.82361	3.74682
743	0.59255	0.539496
744	0.173761	0.379026
745	0.327891	0.410326
746	2.7398	3.27034
747	3.12233	2.83536
748	0.365824	0.277002
749	0.115251	0.261954
750	0.790225	0.834237
751	5.45634	4.81801
752	0.71123	0.702707
753	0.218995	0.181137
754	0.207635	0.298121
755	0.526527	0.509497
756	2.0981	1.53487
757	0.568298	0.599897
758	0.374699	0.275195
759	4.36351	4.10377
760	5.8887	6.40876
761	4.25845	4.30804
762	0.149072	0.269901
763	1.8075	1.58708
764	5.36915	4.65692
765	1.01909	1.88609
766	0.757943	1.22853
767	0.0963477	0.187306
768	1.5132	1.29687
769	0.230416	0.321909
770	0.21791	0.260058
771	0.127121	0.289642
772	0.324166	0.240977
773	1.14381	1.76575
774	4.47527	4.75594
775	1.20534	0.845053
776	0.354215	0.285787
777	6.4048	6.70212
778	2.40749	2.27189
779	4.37005	4.02065
780	6.34164	5.73459
781	0.111004	0.219632
782	6.7095	6.45941
783	0.634386	0.40591
784	5.89782	6.21004
785	6.05794	5.51437
786	5.46872	4.73128
787	0.162949	0.17445
788	0.476209	0.489679
789	0.130232	0.243724
790	10.9515	11.6283
791	2.15137	2.33961
792	5.93061	5.28624
793	5.3158	4.58313
794	6.7992	6.88203
795	0.319173	0.278375
796	2.26535	2.16636
797	2.4611	3.33157
798	0.313528	0.285787
799	3.93393	3.46567
800	0.123449	0.259002
801	1.98354	1.33858
802	6.48951	6.57715
803	3.87245	3.44813
804	0.457614	0.293548
805	1.43853	1.19408
806	0.252203	0.258735
807	0.396884	0.287412
808	4.57048	4.40619
809	1.3264	2.13002
810	4.63955	4.38355
811	1.71312	1.71355
812	5.02743	4.56922
813	2.2693	3.6536
814	0.162812	0.31518
815	0.336933	0.290164
816	6.80004	6.37346
817	1.18229	1.62954
818	0.123325	0.279093
819	0.0939141	0.193187
820	1.3017	2.1108
821	0.172643	0.264123
822	0.608881	0.721417
823	0.804686	0.938414
824	5.67613	5.5517
825	1.71199	2.65492
826	0.126879	0.295064
827	9.3662	9.8239
828	4.25445	4.0218
829	4.10096	3.94295
830	0.929624	0.783007
831	0.874058	1.02127
832	0.150913	0.247903
833	6.19979	6.45804
834	8.89311	9.05237
835	8.18482	8.38661
836	3.04362	2.94934
837	6.53951	7.31246
838	3.21891	2.97301
839	4.78046	4.02713
840	0.410764	0.279813
841	3.02174	2.5976
842	5.60721	4.92088
843	8.08343	7.82815
844	0.401418	0.224645
845	5.61505	4.84475
846	3.87602	3.21024
847	5.67682	5.10686
848	7.04264	7.04616
849	0.214111	0.242784
850	0.17407	0.311788
851	0.17039	0.304485
852	2.86921	2.809
853	2.33608	1.68403
854	4.5479	3.77983
855	0.329591	0.211525
856	0.400542	0.295064
857	1.86317	1.65916
858	3.3141	2.8959
859	5.65621	5.02594
860	5.32237	4.59495
861	1.48264	1.20645
862	0.529137	0.294312
863	4.85114	4.05993
864	5.48049	4.8454
865	6.28347	6.33986
866	0.499533	0.436048
867	0.177348	0.319266
868	0.184829	0.229702
869	5.80567	5.35477
870	0.502433	0.623385
871	0.111745	0.260608
872	0.273761	0.436048
873	0.324021	0.314856
874	0.467978	0.516124
875	0.162918	0.245362
876	0.107353	0.228757
877	0.46574	0.323572
878	0.366965	0.316808
879	0.125618	0.23777
880	0.255214	0.208388
881	4.8224	4.12372
882	3.74558	3.47534
883	2.82086	4.44133
884	0.265874	0.422338
885	1.17459	0.954319
886	0.164471	0.319266
887	4.64361	4.40654
888	2.3304	1.67884
889	8.27573	8.60991
890	5.8783	5.1352
891	0.173055	0.2328
892	0.899548	1.27098
893	8.20623	7.97471
894	0.528991	0.679051
895	5.25834	4.52447
896	5.35922	4.63299
897	1.4805	2.32387
898	7.84971	7.72796
899	1.83435	1.65122
900	5.93928	5.28624
901	0.115877	0.248159
902	0.289192	0.383149
903	6.1597	5.84197
904	2.24409	2.49911
905	2.30866	3.13505
906	0.149663	0.309388
907	5.0054	4.46562
908	0.814036	0.879542
909	5.19876	4.54785
910	7.55868	7.50817
911	0.165192	0.202148
912	2.74816	2.51444
913	0.382429	0.295064
914	0.315696	0.288301
915	0.758176	0.770997
916	0.528768	0.665199
917	0.176123	0.216041
918	8.73944	9.3202
919	5.51049	5.52742
920	3.06529	2.39187
921	5.10059	4.3479
922	4.26071	3.80081
923	0.103697	0.201109
924	0.369809	0.270639
925	3.93061	3.81812
926	8.56041	8.38773
927	4.05917	4.0661
928	3.30755	3.07743
929	6.78686	7.02896
930	4.61912	4.04598
931	9.17788	9.6945
932	2.70093	2.118
933	0.787345	0.492176
934	3.71908	4.34848
935	3.29864	3.19502
936	4.39918	3.62346
937	2.11507	3.0131
938	6.48918	6.33986
939	6.57445	6.59412
940	0.103311	0.20721
941	1.16063	2.04344
942	0.191769	0.387118
943	1.86737	2.79192
944	0.111451	0.222709
945	7.49615	7.54695
946	0.729156	0.801787
947	0.126607	0.22982
948	2.54555	2.8063
949	0.566873	0.348314
950	0.528942	0.547608
951	0.660578	0.684482
952	4.94023	4.3952
953	4.87217	4.10198
954	0.690768	0.883795
955	4.12988	3.78098
956	0.0957089	0.20194
957	2.52125	2.41584
958	0.647288	0.381184
959	0.147567	0.18273
960	6.0266	5.55715
961	0.724229	0.847787
962	0.718626	0.84126
963	2.01267	2.74056
964	3.98082	3.41862
965	3.0228	2.63396
966	10.1204	10.4089
967	0.271357	0.298121
968	2.14098	1.57655
969	1.0746	0.910137
970	0.523674	0.486661
971	6.33871	6.03159
972	5.25048	4.88234
973	1.45148	1.17213
974	10.4279	10.6352
975	6.56694	6.71994
976	0.273908	0.380003
977	4.49994	4.48904
978	0.240158	0.266955
979	6.7834	6.27246
980	0.777062	1.05525
981	9.36613	9.44303
982	5.04482	4.48733
983	6.01415	6.35621
984	5.58436	5.42699
985	7.39908	7.48785
986	0.664891	0.756438
987	4.49496	3.81112
988	0.126094	0.228639
989	2.35075	2.33961
990	4.37602	3.83883
991	2.13616	2.67637
992	0.980004	1.25965
993	2.97577	2.34791
994	2.21112	1.69601
995	2.52267	2.42678
996	2.3744	1.71468
997	4.65055	4.39353
998	1.55521	1.24322
999	0.696062	0.778083
1000	0.268056	0.368246
1001	9.30358	9.54085
1002	0.504408	0.635383
1003	0.337266	0.313561
1004	3.80877	3.37605
1005	5.66389	5.16242
1006	1.08661	1.43123
1007	5.68251	5.99979
1008	0.463747	0.503281
1009	1.95799	1.6659
1010	0.0834461	0.175894
1011	0.492494	0.542505
1012	0.284656	0.316808
1013	1.83089	1.6102
1014	0.813107	1.37387
1015	4.62188	5.00011
1016	3.85136	3.39219
1017	0.658533	0.614365
1018	0.969297	0.977208
1019	1.70272	2.92952
1020	2.27223	2.21297
1021	3.44483	3.18552
1022	4.06927	3.89272
1023	1.8277	1.64046
1024	0.110733	0.23328
1025	2.35552	2.34564
1026	1.72306	1.49346
1027	0.873349	1.02022
1028	1.62599	1.38738
1029	0.244451	0.276232
1030	0.844155	0.823136
1031	3.91046	3.43794
1032	7.19405	6.73728
1033	2.22219	2.39572
1034	5.38042	4.90822
1035	7.4861	7.0835
1036	9.25807	9.41874
1037	0.329342	0.341033
1038	2.65756	5.51426
1039	6.26788	6.13837
1040	2.83632	2.8736
1041	0.582188	0.544196
1042	4.26941	3.76041
1043	3.68178	2.99762
1044	6.35062	7.04183
1045	7.71237	7.37018
1046	0.447197	0.304485
1047	0.332339	0.40927
1048	4.32993	3.62484
1049	0.893558	0.891111
1050	0.167833	0.410326
1051	0.184718	0.274105
1052	1.20315	2.37623
1053	2.16798	1.65628
1054	0.400183	0.223767
1055	5.21247	4.93127
1056	8.60021	8.45281
1057	0.181496	0.342971
1058	0.60065	0.714021
1059	1.9359	1.6011
1060	0.144485	0.348314
1061	1.89034	3.24654
1062	6.95261	6.70009
1063	0.632672	0.727014
1064	2.88698	3.20198
1065	11.0322	11.6943
1066	2.30348	2.2244
1067	0.560446	0.511602
1068	1.03444	1.15874
1069	0.573889	0.666386
1070	5.85196	5.25837
1071	5.20307	5.04043
1072	6.72811	6.83995
1073	0.478642	0.695456
1074	4.60539	3.92217
1075	0.329093	0.29216
1076	0.572308	0.581036
1077	7.55997	7.38919
1078	0.547225	0.333045
1079	1.54908	1.18184
1080	6.49886	6.55697
1081	0.466107	0.525223
1082	5.58656	4.88299
1083	5.58699	4.88299
1084	0.11234	0.242346
1085	2.35008	2.57227
1086	3.16219	3.07743
1087	2.13748	3.05374
1088	4.38312	3.68321
1089	0.334607	0.304329
1090	0.228357	0.299815
1091	2.18605	3.48445
1092	10.0869	10.3554
1093	7.78445	8.81642
1094	3.16182	2.88102
1095	2.65382	2.47794
1096	2.36734	2.55905
1097	8.32419	8.25482
1098	5.95555	5.32725
1099	0.927451	1.29811
1100	4.33838	4.20253
1101	0.176272	0.242471
1102	0.318506	0.485876
1103	0.251167	0.244857
1104	0.462507	0.312754
1105	9.12678	9.15085
1106	3.70022	3.22682
1107	2.13226	1.71467
1108	5.02225	4.39353
1109	0.429998	0.477963
1110	0.160815	0.2972
1111	0.950974	0.805929
1112	0.163412	0.17508
1113	2.36259	2.64076
1114	5.34015	4.70696
1115	8.71235	8.65554
1116	5.3173	4.60857
1117	11.1539	11.9133
1118	0.125573	0.246629
1119	3.66735	3.27878
1120	3.68973	3.56788
1121	0.0848728	0.178175
1122	2.45996	2.47859
1123	6.74242	6.24023
1124	0.487541	0.536317
1125	0.447143	0.373425
1126	0.127607	0.26128
1127	0.282525	0.26128
1128	5.91944	5.28624
1129	0.154945	0.243097
1130	2.17593	2.96536
1131	0.228712	0.226178
1132	3.14006	3.53859
1133	0.24203	0.527086
1134	0.112607	0.198024
1135	6.02859	5.71983
1136	1.71086	1.6435
1137	5.47591	5.38243
1138	5.84286	5.79129
1139	4.89989	4.60466
1140	4.78576	4.80745
1141	0.0928459	0.198535
1142	0.607648	0.719561
1143	1.95625	2.23589
1144	1.94197	2.99773
1145	0.0993465	0.211743
1146	1.6113	1.45158
1147	1.74132	1.5136
1148	4.76669	4.24663
1149	5.26235	4.52387
1150	0.529182	0.353922
1151	4.41548	3.8506
1152	2.02031	2.53804
1153	3.93259	3.46567
1154	2.92688	2.96536
1155	4.57909	4.20972
1156	0.782745	1.32383
1157	5.59208	5.07994
1158	0.522117	0.459577
1159	7.05131	7.23377
1160	1.00468	1.11654
1161	6.10488	5.61471
1162	6.88989	7.46858
1163	7.1291	6.66566
1164	2.67767	2.6433
1165	1.75331	2.69046
1166	1.30002	1.91401
1167	0.566192	0.364283
1168	5.50755	5.06756
1169	2.82066	2.74763
1170	0.423347	0.229654
1171	3.3046	2.7041
1172	3.7649	3.29571
1173	0.329963	0.290389
1174	4.80397	4.3373
1175	4.75169	4.23365
1176	0.312855	0.272023
1177	7.90937	7.60551
1178	0.120369	0.242596
1179	3.95661	3.66676
1180	1.87419	2.48498
1181	0.608605	0.654476
1182	0.419226	0.437878
1183	10.7089	11.2685
1184	0.118481	0.23777
1185	0.171197	0.133036
1186	0.488422	0.321909
1187	0.582768	0.589479
1188	2.45321	2.43932
1189	6.60455	6.50314
1190	1.6905	2.63024
1191	0.363582	0.228204
1192	0.477737	0.32963
1193	0.172381	0.278375
1194	9.03706	9.00585
1195	0.96479	1.06265
1196	2.02653	3.55168
1197	1.56373	1.22893
1198	8.00517	7.78792
1199	3.79303	3.00535
1200	3.68868	3.10931
1201	0.219282	0.254412
1202	0.4998	0.578646
1203	1.56832	2.4899
1204	5.34094	5.01492
1205	4.97265	4.4989
1206	4.49079	3.89197
1207	1.75531	1.52698
1208	6.17799	5.52786
1209	0.963066	1.23205
1210	7.21291	7.40825
1211	0.461611	0.499618
1212	6.66516	6.17543
1213	4.12704	3.63292
1214	7.93841	8.23248
1215	0.619112	0.697297
1216	2.10651	2.27189
1217	3.67954	3.23197
1218	0.132203	0.314369
1219	0.162376	0.369196
1220	4.03149	3.66399
1221	0.308335	0.569145
1222	0.56853	0.55271
1223	1.79867	1.45158
1224	0.397229	0.222583
1225	4.00132	3.62484
1226	11.1213	11.846
1227	3.87026	3.53289
1228	1.27017	0.959249
1229	1.64824	1.27304
1230	4.44034	4.37036
1231	4.48783	4.2022
1232	2.2747	1.74228
1233	4.31072	4.38638
1234	2.25014	2.76183
1235	0.376273	0.21829
1236	5.27973	4.57134
1237	3.2875	3.05374
1238	0.479063	0.499618
1239	2.05459	1.58365
1240	0.923064	1.03187
1241	7.89389	7.7909
1242	4.12767	3.87197
1243	0.107681	0.23777
1244	0.12244	0.263851
1245	6.49359	6.09325
1246	0.746985	0.783007
1247	2.14009	2.46585
1248	1.03691	1.30783
1249	5.37748	5.26992
1250	0.851719	0.998071
1251	0.822875	1.45994
1252	0.258214	0.351197
1253	0.105088	0.223169
1254	0.614047	0.731147
1255	0.326881	0.247393
1256	0.0960602	0.215152
1257	5.79056	5.51437
1258	1.45434	2.26464
1259	3.31777	2.79052
1260	0.36724	0.273259
1261	3.06813	3.04588
1262	7.09419	6.89979
1263	1.25542	1.78612
1264	4.71362	4.34848
1265	3.03245	4.883
1266	0.893264	0.797667
1267	2.97599	2.91987
1268	0.559963	0.342971
1269	4.81932	4.02867
1270	0.568801	0.528209
1271	0.0883649	0.186439
1272	0.504528	0.334938
1273	0.113223	0.238875
1274	5.28686	4.9097
1275	0.250322	0.269068
1276	0.329881	0.26128
1277	0.118717	0.271155
1278	3.48419	3.52948
1279	8.05668	7.70705
1280	0.482184	0.48313
1281	0.0980757	0.213386
1282	7.21104	7.40825
1283	4.0051	3.44514
1284	10.2288	10.5493
1285	5.81526	5.20247
1286	1.97804	2.66125
1287	0.190305	0.238383
1288	2.31108	2.68328
1289	0.154819	0.242846
1290	5.50703	5.58755
1291	0.850694	1.52295
1292	6.18371	5.6292
1293	0.0825153	0.175894
1294	1.01464	1.31188
1295	0.450341	0.506879
1296	4.34751	4.64386
1297	0.525948	0.543672
1298	0.173895	0.28068
1299	10.0725	10.3287
1300	0.247991	0.250678
1301	0.179906	0.276374
1302	4.37093	3.88165
1303	4.04509	3.52948
1304	1.96653	3.046
1305	0.480362	0.589946
1306	4.72188	4.15786
1307	2.39926	2.8063
1308	3.05499	2.91987
1309	3.98496	3.37313
1310	2.44465	2.13788
1311	2.69252	3.8506
1312	0.265845	0.325244
1313	5.89343	5.58586
1314	2.5372	2.47859
1315	6.04226	5.41302
1316	1.50423	2.43069
1317	3.06351	3.11169
1318	0.275123	0.35962
1319	2.91071	3.24349
1320	1.31914	1.94985
1321	0.21134	0.229229
1322	0.178916	0.37053
1323	0.860832	0.989166
1324	0.132471	0.309388
1325	0.788844	0.833807
1326	6.54298	6.09325
1327	0.906071	1.03772
1328	1.75544	2.87747
1329	0.425715	0.278863
1330	3.62279	2.98846
1331	0.516917	0.490436
1332	0.815583	0.819686
1333	0.493655	0.57805
1334	2.96694	2.57227
1335	0.115873	0.239738
1336	0.322053	0.251765
1337	2.31556	3.83118
1338	3.60567	3.32129
1339	9.0806	9.24564
1340	0.362991	0.274812
1341	0.387992	0.251324
1342	4.37663	3.76041
1343	0.175559	0.31518
1344	4.49597	3.80132
1345	5.10703	4.41622
1346	1.64329	1.42124
1347	1.03903	1.47813
1348	1.44283	2.08594
1349	9.95624	10.1651
1350	8.20793	8.47461
1351	1.54963	2.37153
1352	4.23132	4.26857
1353	1.32035	1.97526
1354	1.81635	2.0347
1355	1.84235	3.14665
1356	0.103738	0.226762
1357	0.23298	0.383149
1358	0.121066	0.245235
1359	4.9827	4.83191
1360	3.22736	2.97081
1361	2.01492	1.88046
1362	5.12466	4.52447
1363	1.41939	2.15133
1364	4.57031	3.89249
1365	3.98179	3.56712
1366	0.873349	1.02022
1367	0.106417	0.226762
1368	0.0922301	0.195289
1369	2.31132	3.33157
1370	0.15795	0.298121
1371	5.65096	5.16242
1372	0.177632	0.382163
1373	1.00702	1.04574
1374	0.614733	0.727014
1375	0.732805	0.666386
1376	0.135294	0.26128
1377	2.1854	2.66125
1378	7.67571	8.16217
1379	1.18156	2.08224
1380	0.453084	0.468937
1381	0.0995077	0.21218
1382	0.483243	0.49753
1383	0.141637	0.276945
1384	5.74905	5.14648
1385	3.31826	2.96536
1386	0.401055	0.294305
1387	0.109037	0.233882
1388	0.49671	0.497051
1389	7.37034	7.52653
1390	1.20433	2.12281
1391	4.26446	4.23514
1392	7.93621	7.64479
1393	4.49095	4.25668
1394	4.5966	3.93281
1395	4.2281	3.76641
1396	0.382109	0.22401
1397	1.10894	0.979728
1398	3.80956	3.39061
1399	0.490267	0.564656
1400	4.60466	4.02713
1401	3.78786	3.32129
1402	9.52566	9.85055
1403	3.03467	3.21024
1404	0.27528	0.257008
1405	6.66432	6.12555
1406	5.84866	5.52859
1407	2.01616	1.90076
1408	0.49422	0.492716
1409	2.43472	1.77491
1410	0.49195	0.606904
1411	1.68882	1.25851
1412	0.521007	0.674688
1413	5.45681	5.07563
1414	2.36427	2.6902
1415	0.954838	0.810093
1416	1.99868	3.10943
1417	0.249756	0.239121
1418	0.623812	0.627724
1419	1.05144	0.85645
1420	0.167913	0.18123
1421	0.143937	0.304485
1422	0.108157	0.231484
1423	0.33979	0.257671
1424	3.34922	2.93495
1425	1.46025	2.58647
1426	0.225309	0.302921
1427	0.146264	0.287412
1428	0.519378	0.535057
1429	2.85872	2.53804
1430	4.50551	4.04948
1431	0.143595	0.264123
1432	0.589495	0.637174
1433	0.106289	0.230294
1434	2.23886	3.07743
1435	0.184907	0.282857
1436	0.703205	0.953187
1437	0.137867	0.220995
1438	0.146561	0.288153
1439	0.184807	0.243222
1440	0.320245	0.304485
1441	1.03299	1.34188
1442	5.29396	4.57134
1443	0.135228	0.321247
1444	0.428486	0.364283
1445	0.430871	0.479196
1446	0.0966937	0.209572
1447	0.0963415	0.208602
1448	0.58881	0.662961
1449	4.73225	3.97559
1450	0.119655	0.248927
1451	4.54506	4.67613
1452	2.41533	3.29571
1453	4.04914	3.546
1454	5.0547	4.4299
1455	1.54232	1.42124
1456	0.592294	0.632268
1457	0.902277	0.808008
1458	0.266384	0.404866
1459	6.3279	5.93522
1460	4.2961	3.93431
1461	0.138714	0.307798
1462	0.526161	0.543952
1463	5.59959	4.92088
1464	1.84916	1.32903
1465	1.67024	2.58618
1466	0.129541	0.276232
1467	0.137924	0.255555
1468	8.7697	8.67787
1469	6.50654	6.47608
1470	4.76168	4.28087
1471	4.32611	4.22021
1472	0.183132	0.315993
1473	0.254067	0.245235
1474	0.106095	0.202461
1475	0.403213	0.298121
1476	1.98309	2.24282
1477	4.47931	4.66132
1478	0.103442	0.200798
1479	2.39997	1.9773
1480	0.978946	1.08032
1481	4.7248	4.24663
1482	8.30286	9.54449
1483	6.76788	6.47608
1484	0.436345	0.302141
1485	0.14717	0.346881
1486	1.33135	1.13342
1487	0.160648	0.338407
1488	2.83086	2.77609
1489	3.71787	3.24349
1490	3.89793	3.57132
1491	0.819546	1.45244
1492	6.68948	7.38821
1493	0.249815	0.268376
1494	5.53322	4.97375
1495	7.10245	7.23692
1496	1.08427	1.42989
1497	0.14278	0.243222
1498	5.38602	4.70696
1499	5.60214	4.92276
1500	5.56374	5.0545
1501	6.78408	6.45941
1502	3.59108	3.30422
1503	0.290668	0.408217
1504	2.3944	2.79908
1505	0.20081	0.442612
1506	0.466317	0.48641
1507	0.142328	0.286672
1508	6.18756	6.70265
1509	8.65263	8.51839
1510	3.29222	3.14313
1511	4.07142	3.5587
1512	1.55356	1.13294
1513	0.443226	0.475752
1514	0.234852	0.488386
1515	0.719838	0.84126
1516	1.11998	0.959249
1517	0.121633	0.282857
1518	3.14744	5.25638
1519	0.494971	0.46413
1520	4.33912	3.75073
1521	3.26223	3.87049
1522	6.38764	6.09407
1523	0.697887	0.838108
1524	0.106671	0.245488
1525	0.583542	0.419087
1526	4.70165	3.94295
1527	5.56987	5.18839
1528	1.80138	3.25959
1529	0.308692	0.308592
1530	0.341393	0.318445
1531	0.594964	0.37514
1532	0.127913	0.298121
1533	6.87733	6.35706
1534	1.36186	1.01676
1535	1.68043	2.60625
1536	1.27384	1.02465
1537	4.26604	4.31911
1538	2.62497	4.45308
1539	0.14307	0.243849
1540	5.50279	5.69044
1541	2.46052	1.79884
1542	5.6042	5.54015
1543	2.66284	2.79908
1544	1.84927	2.769
1545	0.165877	0.32274
1546	0.784516	0.725144
1547	4.22595	3.7599
1548	0.615039	0.777911
1549	0.885977	0.793159
1550	0.366748	0.218808
1551	7.89166	7.58594
1552	2.59277	2.95773
1553	5.04926	4.45278
1554	5.10177	5.21589
1555	10.8892	11.6643
1556	0.305532	0.434926
1557	4.56023	3.87049
1558	2.08442	1.98704
1559	2.28353	1.76466
1560	2.22495	1.61852
1561	0.517218	0.668459
1562	0.915108	1.08607
1563	7.20128	7.31246
1564	2.05098	2.68328
1565	0.467954	0.327261
1566	0.796997	0.663258
1567	0.184157	0.319266
1568	0.283997	0.273823
1569	6.02406	5.44099
1570	10.6279	11.391
1571	0.25236	0.271855
1572	8.45451	8.19017
1573	0.107501	0.229702
1574	1.09127	1.57321
1575	0.121356	0.238629
1576	2.07957	3.27047
1577	0.416022	0.229182
1578	0.218838	0.253758
1579	7.27133	7.24628
1580	0.2267	0.415646
1581	0.748805	0.785432
1582	0.364602	0.290568
1583	3.58381	3.29571
1584	5.12516	4.40486
1585	5.81146	6.10978
1586	0.4504	0.246845
1587	3.32756	2.91086
1588	0.589715	0.714021
1589	2.46406	2.1206
1590	3.96471	3.40105
1591	0.191288	0.272556
1592	0.539406	0.505314
1593	0.366341	0.21961
1594	1.26955	0.902664
1595	0.55739	0.729844
1596	0.558214	0.357772
1597	1.95778	3.02878
1598	0.380427	0.21978
1599	8.54856	8.84034
1600	11.1631	12.0989
1601	3.73365	2.95012
1602	2.69905	3.84069
1603	2.75503	2.68328
1604	4.94516	4.25758
1605	1.30615	0.964204
1606	0.815291	0.825259
1607	2.47412	3.21852
1608	5.7406	5.02786
1609	3.18575	2.69582
1610	11.0115	11.7548
1611	5.80002	5.18909
1612	4.67488	4.03752
1613	1.13515	1.74766
1614	3.89177	3.22682
1615	0.113996	0.252545
1616	0.310617	0.28242
1617	5.22218	4.61869
1618	1.61274	1.39153
1619	0.2164	0.253575
1620	1.6255	1.42217
1621	2.61411	2.07908
1622	2.9346	4.75636
1623	3.40431	3.02713
1624	3.30418	2.88845
1625	1.90567	1.63
1626	0.779463	1.27299
1627	0.400703	0.224137
1628	0.767713	0.797667
1629	0.701271	0.678862
1630	0.106076	0.207317
1631	3.76961	3.34549
1632	3.01963	2.5976
1633	4.22681	4.25758
1634	2.47466	2.35926
1635	0.498619	0.495772
1636	0.744868	0.780188
1637	0.805933	1.37387
1638	0.61648	0.78036
1639	0.370364	0.271155
1640	1.33953	1.20334
1641	10.3345	10.8903
1642	0.200469	0.161892
1643	0.143428	0.281404
1644	3.39116	2.8063
1645	1.89972	1.41851
1646	2.25928	2.77609
1647	7.12113	6.82814
1648	0.182003	0.225248
1649	0.840313	1.16559
1650	0.374547	0.275053
1651	1.52664	1.31369
1652	6.01962	5.41302
1653	3.45489	2.74763
1654	2.61274	1.94138
1655	0.928284	1.30213
1656	0.14926	0.294912
1657	7.44408	7.50717
1658	8.60543	9.05116
1659	0.461433	0.516635
1660	0.0975601	0.211961
1661	5.45049	5.30833
1662	0.580398	0.670174
1663	4.03991	3.34016
1664	0.0995521	0.216933
1665	3.83364	3.14313
1666	0.230712	0.256254
1667	6.90171	7.17903
1668	2.49877	2.05776
1669	4.86996	4.10198
1670	3.30483	2.95012
1671	0.61423	0.408217
1672	3.81493	3.33157
1673	3.07537	3.20969
1674	1.9708	2.59891
1675	2.93379	2.4583
1676	0.288845	0.267547
1677	0.191234	0.334938
1678	2.33839	2.29201
1679	6.09613	5.46909
1680	2.65621	3.00535
1681	7.83381	7.70808
1682	0.205835	0.311788
1683	0.114028	0.22548
1684	1.82412	1.4103
1685	0.415093	0.423893
1686	6.56362	6.73817
1687	0.111028	0.251895
1688	4.95605	5.4993
1689	5.14554	4.88447
1690	4.92433	4.74348
1691	9.37852	9.41874
1692	4.48586	3.80132
1693	0.503211	0.496027
1694	0.693559	0.653134
1695	6.68456	6.04634
1696	0.638896	0.778983
1697	3.72125	2.94253
1698	0.823522	0.812182
1699	0.508317	0.607219
1700	0.315057	0.28756
1701	4.08202	3.81031
1702	0.184087	0.282712
1703	0.114248	0.256346
1704	2.90048	2.58556
1705	0.104041	0.215152
1706	0.966587	1.23777
1707	0.643713	0.808008
1708	4.27481	3.58631
1709	0.0887203	0.183391
1710	0.505313	0.476488
1711	0.286214	0.337536
1712	3.13713	2.9864
1713	0.484625	0.595444
1714	0.381555	0.220608
1715	0.601241	0.729265
1716	0.522819	0.497563
1717	0.0982454	0.194385
1718	0.496584	0.454896
1719	6.32855	5.71983
1720	2.02609	1.91567
1721	0.143476	0.266447
1722	4.08383	4.90822
1723	1.23352	0.870239
1724	0.245973	0.248799
1725	2.49325	2.23014
1726	1.10305	1.40856
1727	2.89284	3.21024
1728	5.41402	5.17322
1729	0.562503	0.743671
1730	0.438653	0.466287
1731	0.178224	0.305271
1732	1.20349	0.895715
1733	0.0810229	0.169227
1734	6.31529	6.11164
1735	4.35021	4.27699
1736	1.84605	2.07707
1737	1.06352	1.07162
1738	0.120865	0.193885
1739	0.3296	0.246121
1740	5.58652	5.54014
1741	2.97535	2.81613
1742	0.465954	0.298121
1743	0.388279	0.305271
1744	5.05502	5.10686
1745	6.04243	5.60027
1746	0.239444	0.226645
1747	5.67239	5.16242
1748	0.752375	0.769806
1749	3.82068	3.5204
1750	0.381771	0.220767
1751	2.79368	2.43159
1752	11.5648	12.421
1753	0.187829	0.450899
1754	4.40153	3.87049
1755	1.64805	1.33828
1756	0.101385	0.222022
1757	5.41501	5.01301
1758	1.52524	1.2517
1759	2.97092	2.93495
1760	2.2786	2.8063
1761	4.65999	4.40486
1762	3.56509	3.02958
1763	5.84583	5.12199
1764	0.100843	0.206783
1765	6.00822	6.49192
1766	0.230515	0.255977
1767	0.104917	0.222709
1768	5.68779	5.10686
1769	0.125127	0.226412
1770	1.04282	1.485
1771	7.26741	8.08119
1772	0.120395	0.193187
1773	0.711324	0.943138
1774	0.697711	0.808537
1775	7.86747	7.89295
1776	0.97538	1.07533
1777	1.67359	1.37656
1778	7.01087	7.17808
1779	0.183287	0.144468
1780	0.100754	0.218504
1781	2.10131	1.98398
1782	0.195278	0.29219
1783	2.57742	2.26543
1784	0.182601	0.331333
1785	5.88705	5.24284
1786	2.63816	3.06951
1787	2.05755	2.34564
1788	0.222237	0.244353
1789	0.262657	0.255819
1790	4.19684	4.06047
1791	0.403311	0.404476
1792	5.3976	5.30833
1793	2.82532	2.75738
1794	0.158997	0.200902
1795	5.21211	5.0545
1796	2.01462	2.28363
1797	2.80456	3.9126
1798	7.36999	7.21516
1799	2.82385	2.1924
1800	7.48779	8.45168
1801	0.312597	0.269651
1802	2.29551	1.68403
1803	0.622133	0.640795
1804	7.37025	6.95332
1805	0.267255	0.311788
1806	2.37171	2.30847
1807	0.180609	0.250084
1808	4.44749	4.00644
1809	0.525909	0.352103
1810	3.55021	3.18552
1811	4.66143	4.27958
1812	2.38161	2.03562
1813	6.97207	7.02896
1814	0.362404	0.277659
1815	2.64258	2.15766
1816	4.60856	3.92269
1817	5.22581	5.27152
1818	1.969	2.2244
1819	0.141605	0.262224
1820	0.211775	0.25248
1821	1.42979	2.51809
1822	3.3141	2.8959
1823	4.29761	4.03907
1824	5.01968	4.27958
1825	2.04839	2.33238
1826	6.19512	5.57149
1827	3.82162	3.51088
1828	2.53133	2.33298
1829	2.75064	2.66125
1830	1.21002	0.827388
1831	0.0910657	0.195289
1832	0.214951	0.243285
1833	2.63346	2.34564
1834	1.84395	1.54359
1835	4.27422	3.4933
1836	0.160118	0.253457
1837	2.78591	4.60686
1838	0.107245	0.194485
1839	4.01716	3.67233
1840	6.60268	6.06194
1841	4.2837	3.57661
1842	5.57049	5.50895
1843	1.19489	0.838547
1844	5.03378	4.27958
1845	0.249352	0.238629
1846	5.98979	5.57149
1847	4.99117	4.7431
1848	9.81146	10.0868
1849	2.43515	2.44687
1850	6.39548	6.48641
1851	0.248305	0.473031
1852	5.71896	6.12789
1853	5.30317	5.04954
1854	6.35141	6.81003
1855	4.9176	4.20093
1856	4.0339	3.66239
1857	2.50774	3.74108
1858	4.8858	5.4127
1859	0.198015	0.28068
1860	2.37611	2.19253
1861	0.731691	0.664671
1862	2.19548	2.4019
1863	0.671003	0.76664
1864	0.19015	0.238138
1865	2.65848	3.58631
1866	8.18433	9.39325
1867	4.35468	4.09321
1868	2.64113	2.74763
1869	7.54103	7.64711
1870	0.667015	0.521682
1871	0.989058	1.23768
1872	4.21997	3.73145
1873	3.74395	2.96536
1874	0.299561	0.28068
1875	2.18109	2.02817
1876	2.71276	2.84268
1877	2.97029	3.64405
1878	1.85276	1.63776
1879	0.354153	0.269651
1880	0.366705	0.29889
1881	0.2274	0.489646
1882	0.215292	0.346524
1883	0.218238	0.332188
1884	0.115219	0.23232
1885	1.89722	1.47496
1886	5.79709	5.32725
1887	9.43141	9.56911
1888	0.134106	0.308592
1889	0.665845	0.452295
1890	5.49788	4.98724
1891	1.84281	3.23915
1892	1.61309	2.5964
1893	1.95394	2.89592
1894	0.277793	0.219972
1895	0.132627	0.305114
1896	0.823931	1.41846
1897	0.143903	0.176985
1898	0.244423	0.249569
1899	2.72863	2.40013
1900	1.9255	2.96547
1901	1.94746	2.26022
1902	0.35037	0.29009
1903	6.24113	5.69044
1904	2.42069	2.29661
1905	0.666138	0.881579
1906	2.30317	1.95964
1907	2.89531	2.41934
1908	4.91738	4.58313
1909	0.129281	0.290389
1910	4.3434	3.89197
1911	1.29787	1.8632
1912	0.805308	0.98898
1913	4.39198	4.14661
1914	1.67009	1.43537
1915	1.24862	0.883795
1916	2.93722	2.90337
1917	0.354153	0.269651
1918	1.28743	1.85562
1919	0.175983	0.285787
1920	0.833744	0.906691
1921	0.138041	0.334076
1922	5.68175	5.12199
1923	5.34554	4.76798
1924	4.64015	4.11468
1925	2.97106	2.90337
1926	0.248703	0.266859
1927	0.915633	0.823136
1928	6.15	5.55715
1929	4.07163	3.64405
1930	2.25409	4.42729
1931	5.41164	5.22421
1932	0.173683	0.287412
1933	2.41451	2.42054
1934	4.7767	4.2665
1935	0.914783	0.936797
1936	7.75089	7.60841
1937	1.4642	1.09522
1938	2.59366	4.9709
1939	2.03743	2.71107
1940	1.51695	1.16611
1941	10.961	11.6943
1942	0.53289	0.530664
1943	2.83388	3.4557
1944	3.55516	4.21176
1945	1.40797	1.21695
1946	0.312597	0.269651
1947	2.03842	3.87011
1948	2.89284	3.21024
1949	2.95494	2.55905
1950	4.71893	4.47578
1951	0.24329	0.196095
1952	0.230338	0.255726
1953	0.312597	0.269651
1954	1.97052	3.05386
1955	3.49248	3.08537
1956	0.154026	0.319266
1957	2.69319	2.42701
1958	1.69854	2.5845
1959	0.806676	0.898309
1960	2.85203	2.76183
1961	0.290795	0.291138
1962	5.18259	4.3952
1963	0.559233	0.56422
1964	3.60567	3.32129
1965	0.421575	0.275422
1966	0.280965	0.223169
1967	4.26047	3.8303
1968	2.30673	2.00556
1969	4.8444	4.4989
1970	7.08883	7.23377
1971	3.98096	3.80132
1972	4.81263	4.11311
1973	6.61317	6.84314
1974	0.195685	0.412871
1975	0.607852	0.370148
1976	5.36937	5.66044
1977	0.863203	1.55146
1978	1.57318	1.28623
1979	0.436351	0.695456
1980	0.412216	0.365411
1981	1.33477	2.01649
1982	0.420611	0.227781
1983	9.35761	9.3945
1984	0.339925	0.269651
1985	0.351264	0.266859
1986	0.371246	0.223353
1987	0.347663	0.250213
1988	4.90708	4.57134
1989	8.59479	8.54036
1990	5.89011	6.11212
1991	0.223079	0.257538
1992	2.06713	1.9385
1993	0.40372	0.226283
1994	0.106895	0.189734
1995	5.09164	4.3597
1996	1.08443	1.02465
1997	0.420995	0.27494
1998	6.92296	7.04368
1999	6.72381	6.22417
2000	3.8615	3.35412
2001	2.16404	1.63529
2002	5.32004	5.0545
2003	0.283828	0.226062
2004	8.65514	8.84034
2005	0.0948853	0.202461
2006	2.03672	2.36384
2007	3.72317	3.2013
2008	8.18845	8.42993
2009	0.141742	0.240977
2010	6.159	5.61471
2011	1.91126	2.45318
2012	0.36167	0.276945
2013	3.20548	3.61414
2014	0.29805	0.284319
2015	2.35733	2.2907
2016	0.374608	0.27511
2017	8.54123	8.38773
2018	0.250469	0.260608
2019	11.2717	12.0677
2020	2.35905	2.22009
2021	9.09479	9.07572
2022	1.72596	1.49506
2023	4.82302	4.70696
2024	5.56811	4.91009
2025	8.71275	10.169
2026	3.05623	2.85473
2027	0.547899	0.507663
2028	0.208542	0.283587
2029	3.57118	4.27958
2030	3.61241	3.46157
2031	0.107025	0.202044
2032	3.7637	3.48248
2033	0.573972	0.581036
2034	3.00014	4.79326
2035	0.129541	0.276232
2036	3.491	4.30169
2037	5.78653	5.42584
2038	0.26473	0.307006
2039	2.66956	4.55991
2040	6.09252	5.60027
2041	0.574364	0.338407
2042	0.248759	0.397425
2043	4.50409	3.82095
2044	0.339925	0.269651
2045	4.61487	4.15378
2046	5.65264	5.29987
2047	6.67523	6.59592
2048	2.01169	3.13517
2049	1.34584	1.96251
2050	0.087672	0.183107
2051	4.35822	3.64405
2052	7.36021	6.97126
2053	0.570224	0.578348
2054	0.17873	0.273964
2055	6.32437	5.76718
2056	0.338674	0.436048
2057	0.167113	0.38236
2058	1.90739	2.44687
2059	0.322229	0.248825
2060	0.18162	0.135247
2061	0.521381	0.364283
2062	1.03481	1.30446
2063	10.8159	11.509
2064	5.59455	5.54014
2065	0.177386	0.258602
2066	8.50586	8.40825
2067	0.134717	0.214599
2068	0.585248	0.558723
2069	7.16744	6.70009
2070	8.42395	8.74854
2071	6.53686	6.19219
2072	0.293134	0.368246
2073	0.421805	0.228592
2074	1.57501	1.33341
2075	2.91335	3.00481
2076	5.69192	5.55715
2077	0.238198	0.376108
2078	0.467599	0.508597
2079	0.339925	0.269651
2080	1.49024	1.21331
2081	0.56881	0.347417
2082	3.05757	4.61869
2083	0.206537	0.215152
2084	6.75667	6.56202
2085	0.903578	0.838547
2086	0.407255	0.307798
2087	0.252424	0.243222
2088	0.124519	0.225016
2089	0.65673	0.42452
2090	3.12378	5.02594
2091	0.585177	0.346524
2092	3.55463	3.4027
2093	0.778243	0.49753
2094	2.98392	3.52948
2095	6.24499	5.71983
2096	4.05475	3.89249
2097	7.14964	7.06378
2098	0.366757	0.219927
2099	2.16211	2.02189
2100	4.60105	3.93281
2101	10.6297	11.3559
2102	9.10413	9.54085
2103	3.99215	4.76862
2104	2.55864	2.60562
2105	4.11791	3.47534
2106	0.580435	0.678862
2107	2.0177	1.81747
2108	4.6046	3.94446
2109	5.62726	5.76641
2110	4.14686	3.51134
2111	3.4214	3.19962
2112	3.01261	2.80924
2113	10.5154	11.1228
2114	7.23258	7.23377
2115	0.455493	0.289642
2116	0.483976	0.497307
2117	3.13176	3.00574
2118	5.83109	6.17543
2119	0.259523	0.396403
2120	2.68654	2.76895
2121	4.47642	3.77011
2122	4.65208	4.31077
2123	0.349245	0.264804
2124	2.94056	4.76863
2125	0.212751	0.239195
2126	0.583083	0.594972
2127	0.176748	0.440565
2128	4.04297	3.65345
2129	0.254704	0.269096
2130	5.20999	4.47578
2131	1.89912	1.42124
2132	0.287516	0.238998
2133	0.645933	0.682721
2134	3.28103	3.13371
2135	1.88224	3.04708
2136	4.87876	4.22263
2137	0.175625	0.300588
2138	4.11134	3.71228
2139	1.19552	2.10268
2140	3.94808	3.45231
2141	0.15244	0.302921
2142	0.605821	0.383149
2143	3.60044	2.82079
2144	2.53933	1.82771
2145	0.49802	0.576028
2146	0.571142	0.543392
2147	6.88266	6.74893
2148	5.29163	4.70696
2149	0.0939498	0.202044
2150	0.0959656	0.210872
2151	1.36696	1.12075
2152	8.26111	8.54036
2153	0.26313	0.299815
2154	0.234736	0.259322
2155	0.166893	0.367298
2156	2.65335	2.79187
2157	0.937639	1.72342
2158	0.516438	0.531211
2159	0.26862	0.294305
2160	0.251388	0.250084
2161	0.270638	0.250471
2162	5.94777	5.36858
2163	6.08454	5.52859
2164	3.91511	3.61792
2165	4.87888	4.11311
2166	0.960506	0.874735
2167	5.22668	4.51051
2168	0.114727	0.202774
2169	3.77642	3.75776
2170	7.90564	7.91331
2171	4.41184	4.29005
2172	0.117722	0.252284
2173	0.354535	0.289612
2174	4.81941	5.32739
2175	1.72561	1.57551
2176	2.26006	2.28363
2177	1.08901	1.4351
2178	0.332576	0.479411
2179	5.77886	5.17505
2180	4.87905	4.13436
2181	2.57175	2.13443
2182	0.653976	0.677115
2183	0.173735	0.134969
2184	0.346965	0.293548
2185	1.92807	1.59287
2186	0.428	0.280766
2187	4.84558	4.63237
2188	0.210679	0.253313
2189	2.46695	2.36384
2190	5.53357	4.90822
2191	0.157083	0.380787
2192	5.22306	4.58313
2193	1.28024	2.06667
2194	0.106379	0.192491
2195	1.06243	1.52137
2196	4.67395	4.46206
2197	1.06675	1.52922
2198	0.611078	0.657857
2199	4.9624	4.70287
2200	2.81508	2.71107
2201	3.48658	4.54785
2202	0.122234	0.281404
2203	8.9671	9.3945
2204	2.24052	1.56032
2205	0.127718	0.241847
2206	2.22203	2.71806
2207	0.0987941	0.215374
2208	0.345762	0.277016
2209	0.236208	0.261523
2210	1.99157	1.82698
2211	3.09277	2.48099
2212	5.89147	5.38243
2213	3.57655	3.28724
2214	0.119577	0.249056
2215	0.44494	0.42452
2216	0.517302	0.343856
2217	7.99974	8.14808
2218	3.27724	2.9899
2219	5.02821	4.85552
2220	0.509902	0.517167
2221	10.5105	11.1817
2222	0.102133	0.222022
2223	3.49744	2.71806
2224	0.445702	0.487413
2225	0.268557	0.262224
2226	0.38465	0.257405
2227	6.47595	6.78422
2228	5.28329	4.57073
2229	2.75581	2.48498
2230	4.6483	4.42931
2231	0.182641	0.268376
2232	4.08006	4.02713
2233	2.82012	2.63396
2234	4.04319	3.70863
2235	1.4246	1.38082
2236	0.3115	0.283441
2237	3.9482	3.24349
2238	4.68673	4.50062
2239	0.929825	1.04149
2240	1.96034	3.60568
2241	2.95979	2.85884
2242	5.11398	4.58313
2243	0.263221	0.40591
2244	2.35821	2.01366
2245	0.16869	0.193087
2246	3.68103	3.41148
2247	1.9182	1.39891
2248	3.02542	2.35397
2249	4.93787	4.17934
2250	3.8341	3.69809
2251	0.565783	0.508719
2252	10.1389	10.4089
2253	2.25169	2.71806
2254	0.605421	0.554431
2255	1.43978	2.29912
2256	0.1697	0.208388
2257	4.4119	3.72185
2258	6.97292	6.47521
2259	5.49565	5.01301
2260	3.53864	3.47756
2261	0.174419	0.306216
2262	4.88823	4.84475
2263	4.26234	3.88247
2264	2.05936	1.57168
2265	4.90764	4.19012
2266	2.38519	2.25077
2267	0.493198	0.568949
2268	4.59006	4.19012
2269	0.104325	0.222824
2270	6.13173	5.60027
2271	0.63408	0.748683
2272	8.36435	8.23358
2273	10.8783	11.5983
2274	1.08407	1.21435
2275	2.40272	2.82079
2276	4.90536	4.75572
2277	0.142549	0.242721
2278	1.0324	0.95678
2279	3.13245	2.90258
2280	5.59341	4.96161
2281	2.37009	2.21855
2282	0.185204	0.230294
2283	4.88074	4.09143
2284	0.652747	0.421252
2285	0.248703	0.266859
2286	3.45946	3.44855
2287	7.46503	7.3692
2288	1.41573	1.04451
2289	7.39208	7.17903
2290	4.17982	3.5204
2291	5.56569	5.32725
2292	2.85648	2.76183
2293	3.47583	4.60681
2294	5.55521	4.92276
2295	4.51566	4.15731
2296	5.41112	5.32202
2297	6.42462	6.82814
2298	4.35521	3.75859
2299	0.986341	0.695456
2300	0.868775	0.957587
2301	0.572881	0.353011
2302	0.587089	0.709986
2303	2.94163	2.59736
2304	7.94819	8.16846
2305	0.135105	0.330481
2306	2.1934	1.81877
2307	4.98298	5.16173
2308	0.628917	0.589132
2309	2.05172	2.74763
2310	0.506923	0.326083
2311	4.53384	3.77011
2312	0.218476	0.300588
2313	0.165299	0.167751
2314	4.79389	4.16858
2315	3.32389	3.27878
2316	0.208766	0.558686
2317	0.147569	0.266447
2318	2.24169	2.12346
2319	0.283197	0.437173
2320	5.29062	4.79508
2321	2.20038	2.20728
2322	3.19639	2.8063
2323	5.7308	5.06687
2324	4.72088	4.0704
2325	0.698687	0.650777
2326	2.07891	2.58556
2327	0.543833	0.342088
2328	0.0938261	0.196905
2329	1.18306	1.64771
2330	0.150897	0.274105
2331	9.28688	9.31737
2332	2.97035	2.81353
2333	1.48084	2.4866
2334	6.12024	5.49735
2335	4.43986	3.6818
2336	4.13602	3.98585
2337	5.79468	5.12003
2338	5.28415	4.64432
2339	0.258613	0.490909
2340	2.82445	2.49911
2341	6.24439	5.6292
2342	7.35868	6.93543
2343	3.20417	2.98221
2344	8.21991	8.52097
2345	0.197534	0.279813
2346	4.0622	3.63419
2347	0.863962	1.1698
2348	0.913778	0.821018
2349	0.902039	1.03186
2350	2.45583	2.16671
2351	0.178247	0.184623
2352	0.884879	1.20591
2353	4.03221	4.14758
2354	1.40323	0.995503
2355	0.162828	0.211852
2356	0.964978	0.65951
2357	6.57509	6.59732
2358	1.03627	1.05736
2359	8.87131	8.79491
2360	4.36103	3.77983
2361	1.76186	1.61812
2362	2.04083	1.7783
2363	0.0986496	0.171244
2364	2.21423	3.19374
2365	6.99517	7.24628
2366	2.3218	2.62719
2367	8.86281	9.1969
2368	0.428778	0.307687
2369	1.44994	2.42086
2370	2.82845	2.99762
2371	0.352323	0.333045
2372	0.364216	0.22871
2373	4.06067	3.66239
2374	0.887744	0.901751
2375	0.124535	0.288153
2376	0.174984	0.214267
2377	2.24013	3.37477
2378	5.24109	4.59495
2379	0.706011	0.792242
2380	0.868752	0.983414
2381	4.7598	4.51223
2382	1.89156	1.54757
2383	0.771715	1.30017
2384	0.15782	0.194887
2385	0.108682	0.220995
2386	2.40072	2.23589
2387	5.90182	5.28624
2388	5.32676	4.61869
2389	2.68501	1.973
2390	4.04834	3.44514
2391	0.212563	0.165178
2392	3.53692	3.54057
2393	5.36256	5.22865
2394	3.96264	3.65163
2395	0.690721	0.770503
2396	7.25741	7.34966
2397	0.179155	0.24752
2398	0.619486	0.6274
2399	4.66555	4.25758
2400	5.67294	5.02786
2401	4.43648	4.1806
2402	0.244793	0.271072
2403	0.52432	0.292793
2404	2.91269	2.8736
2405	5.21785	4.4989
2406	4.98201	4.22263
2407	0.401189	0.412446
2408	0.460823	0.49925
2409	6.18388	6.06194
2410	5.65119	4.97441
2411	0.37036	0.273259
2412	8.70714	9.2723
2413	0.0949782	0.204347
2414	5.64916	5.00011
2415	1.05256	1.02201
2416	4.78256	4.31278
2417	0.663729	0.744835
2418	2.73619	3.64405
2419	2.33374	1.96501
2420	3.35818	3.12467
2421	5.08967	4.39353
2422	5.09236	4.4299
2423	5.14048	5.26992
2424	0.518478	0.670529
2425	1.45486	1.29269
2426	2.62797	2.59733
2427	4.51893	4.3687
2428	4.69692	4.14716
2429	0.157109	0.358695
2430	3.89516	3.80132
2431	0.143244	0.244227
2432	0.953904	1.04582
2433	5.7962	5.41303
2434	0.52061	0.475752
2435	0.13174	0.239245
2436	5.69889	5.40771
2437	0.766826	0.945613
2438	0.510841	0.338407
2439	4.18813	3.82095
2440	0.266716	0.245868
2441	0.40106	0.224391
2442	0.244407	0.367298
2443	0.275504	0.257273
2444	0.172811	0.288896
2445	0.465839	0.545165
2446	3.57201	3.08835
2447	1.87679	2.53804
2448	0.278442	0.226996
2449	0.147449	0.266172
2450	0.434885	0.257405
2451	0.481537	0.527086
2452	4.05117	3.66288
2453	3.43409	5.32725
2454	0.760603	0.770203
2455	2.00355	3.11906
2456	3.82773	3.72185
2457	1.65675	2.55967
2458	3.60169	3.25189
2459	2.80871	2.62043
2460	0.67903	0.785027
2461	2.07562	3.127
2462	5.27263	5.38449
2463	0.402761	0.343348
2464	5.81338	5.54285
2465	2.42834	2.11596
2466	4.47642	3.77011
2467	0.341875	0.49753
2468	0.130407	0.269762
2469	0.25384	0.244101
2470	1.2373	1.7159
2471	0.966572	0.731097
2472	0.726926	0.822185
2473	6.08182	5.4832
2474	0.326401	0.269623
2475	0.79227	0.833807
2476	0.313111	0.286672
2477	2.28664	3.77047
2478	0.0882217	0.186056
2479	5.31019	4.81801
2480	0.572101	0.639147
2481	0.874679	0.865321
2482	0.136299	0.317626
2483	3.75323	2.95773
2484	3.71787	3.24349
2485	0.657162	0.829522
2486	0.287884	0.230176
2487	0.696452	0.92915
2488	5.52124	5.14648
2489	0.671496	0.768617
2490	0.389303	0.288896
2491	0.517277	0.532307
2492	2.73162	3.06951
2493	8.3	8.65439
2494	4.38189	3.85176
2495	0.673892	0.856449
2496	5.35612	4.73191
2497	0.116603	0.206996
2498	2.91615	2.29883
2499	3.11303	4.96162
2500	5.94141	5.51437
2501	6.73778	6.77208
2502	0.96693	0.849856
2503	0.100746	0.200695
2504	5.93025	5.6292
2505	0.103383	0.22548
2506	0.191286	0.49625
2507	6.11917	5.95132
2508	6.19357	5.58586
2509	0.447063	0.314369
2510	1.4321	1.10926
2511	4.42086	3.73145
2512	4.53305	3.83081
2513	6.45411	5.95132
2514	7.57817	7.3692
2515	2.75469	2.59823
2516	0.540208	0.302923
2517	0.606417	0.717709
2518	0.253742	0.289642
2519	0.475853	0.476947
2520	4.85811	4.29218
2521	0.384272	0.222606
2522	0.305338	0.277659
2523	3.40817	3.4291
2524	0.743366	0.654476
2525	2.91048	3.23515
2526	0.107012	0.237647
2527	5.22553	4.63237
2528	4.63107	4.40619
2529	4.88656	4.81555
2530	5.19264	4.51051
2531	0.563699	0.645767
2532	3.27003	3.57708
2533	2.22446	2.76895
2534	0.187866	0.378051
2535	1.95002	1.77868
2536	5.02293	4.29062
2537	0.214477	0.350293
2538	5.18507	5.04954
2539	0.486356	0.534662
2540	0.75457	1.22159
2541	6.65964	6.10978
2542	5.73211	5.17505
2543	4.57928	4.3373
2544	0.336982	0.282857
2545	4.8758	4.73128
2546	5.24393	4.74411
2547	5.82721	5.32654
2548	0.440077	0.455131
2549	1.7115	1.44061
2550	0.553333	0.32274
2551	9.62952	9.9834
2552	3.99305	3.38183
2553	2.53642	2.91987
2554	2.3979	4.39844
2555	2.77589	2.07909
2556	2.18281	2.66125
2557	0.569166	0.649103
2558	0.239802	0.254216
2559	0.133954	0.213056
2560	1.02195	1.17433
2561	1.98995	1.8251
2562	2.481	2.50556
2563	6.74119	6.58035
2564	8.4809	8.47461
2565	2.21718	2.49911
2566	8.14954	8.08226
2567	5.22123	4.74411
2568	2.40118	2.60562
2569	0.611917	0.37514
2570	9.45595	9.69446
2571	2.93665	3.84069
2572	4.24939	3.82095
2573	2.15384	2.96536
2574	0.124394	0.292943
2575	0.498394	0.468213
2576	3.00255	2.94253
2577	2.44589	2.15558
2578	1.75443	1.42124
2579	0.710568	0.640795
2580	3.39006	2.70279
2581	3.02493	2.66381
2582	4.83095	4.07095
2583	5.25134	4.52447
2584	2.80213	2.74321
2585	5.76602	5.49945
2586	5.70021	5.88953
2587	0.874852	0.827388
2588	1.1817	2.21313
2589	4.09487	3.83197
2590	0.429948	0.282391
2591	0.101484	0.202565
2592	3.47227	2.6902
2593	6.6408	7.12281
2594	1.95339	1.68204
2595	3.55865	3.3636
2596	2.8208	2.71806
2597	0.348174	0.280188
2598	0.423742	0.229927
2599	0.324655	0.245995
2600	3.38347	2.97301
2601	1.02444	1.1387
2602	2.27647	2.85148
2603	3.57767	3.3262
2604	3.41068	3.08372
2605	0.92746	1.09169
2606	4.00891	3.73096
2607	0.240908	0.271155
2608	0.110316	0.247011
2609	0.747968	0.900399
2610	4.26415	3.76155
2611	0.802753	0.894152
2612	3.50257	3.25353
2613	4.18438	3.64229
2614	0.306883	0.236792
2615	3.09081	2.90237
2616	6.5678	6.39234
2617	2.08479	1.67451
2618	6.17324	5.55715
2619	8.89462	8.81759
2620	4.67957	4.50062
2621	1.43105	2.28142
2622	3.74399	3.63468
2623	2.89411	2.66949
2624	3.05525	2.91274
2625	0.176427	0.301364
2626	5.11066	4.37095
2627	0.360455	0.225713
2628	6.40717	5.82692
2629	1.5386	2.41034
2630	0.123289	0.259402
2631	0.145774	0.255029
2632	0.333301	0.269068
2633	6.92884	6.61434
2634	4.26323	3.92388
2635	0.337113	0.240604
2636	6.37957	6.2533
2637	2.86752	2.81353
2638	2.44132	3.29571
2639	0.178754	0.18529
2640	0.401597	0.224773
2641	6.3273	6.10978
2642	0.443945	0.476733
2643	3.61768	2.91987
2644	1.35541	1.9688
2645	4.41417	4.17878
2646	5.88514	6.27486
2647	0.23073	0.25628
2648	4.63204	4.40619
2649	4.49216	3.90253
2650	0.322056	0.312432
2651	5.71313	5.13324
2652	0.212592	0.253718
2653	0.106265	0.231484
2654	7.41959	7.10177
2655	5.46402	4.81985
2656	2.37891	2.77609
2657	0.805933	1.37387
2658	0.125561	0.279813
2659	4.06921	3.80918
2660	1.94591	3.00547
2661	0.155446	0.178542
2662	2.11862	3.02867
2663	3.67374	4.29062
2664	1.69384	1.2887
2665	0.563901	0.36241
2666	5.29216	5.18798
2667	1.15184	1.78038
2668	0.0928455	0.17928
2669	6.04392	6.04586
2670	2.84362	3.53859
2671	0.177204	0.244101
2672	7.03816	6.94649
2673	0.172885	0.32963
2674	5.22541	4.8009
2675	0.148251	0.269345
2676	2.70489	2.42678
2677	0.598163	0.649103
2678	2.63646	2.1017
2679	4.45111	4.78092
2680	0.358749	0.274105
2681	4.30272	3.76041
2682	3.83717	3.5277
2683	7.17073	7.40727
2684	0.15067	0.34706
2685	0.572279	0.430245
2686	0.241797	0.400715
2687	3.1613	2.89376
2688	0.0894152	0.191996
2689	3.49727	3.59072
2690	0.399108	0.269762
2691	0.504222	0.560453
2692	1.4263	1.40595
2693	1.20818	1.79042
2694	2.38224	3.02087
2695	4.63157	4.96161
2696	0.218714	0.253575
2697	1.61239	1.37245
2698	1.60374	1.32798
2699	0.810849	1.38452
2700	2.03173	2.13788
2701	2.87406	2.24498
2702	0.132473	0.271155
2703	6.27396	6.93451
2704	0.899539	0.602956
2705	6.44958	6.40832
2706	0.18894	0.328782
2707	3.51802	3.44681
2708	6.08101	5.52859
2709	1.52553	1.1909
2710	5.69119	6.09325
2711	2.03799	1.62688
2712	4.55542	3.96483
2713	0.144578	0.218504
2714	0.107721	0.234244
2715	0.247727	0.387118
2716	0.660663	0.561572
2717	0.117063	0.242097
2718	0.347269	0.288123
2719	0.909723	1.06337
2720	2.88755	3.07743
2721	5.69224	5.26737
2722	1.0582	1.19266
2723	0.446111	0.47969
2724	5.81819	5.55715
2725	3.2516	3.22754
2726	2.68433	2.59891
2727	0.247952	0.459577
2728	6.96346	6.78955
2729	8.8291	9.17446
2730	1.0999	1.45353
2731	0.611542	0.5456
2732	3.18103	3.06951
2733	0.559094	0.363345
2734	4.29555	3.97475
2735	4.48816	4.268
2736	1.43405	2.12819
2737	0.354153	0.269651
2738	2.3597	2.74763
2739	0.0909826	0.193486
2740	0.148592	0.218279
2741	0.187221	0.247265
2742	6.44149	6.93451
2743	5.08969	5.20247
2744	0.222362	0.325244
2745	5.87145	5.34028
2746	5.13391	4.98876
2747	0.269754	0.331333
2748	8.43839	8.40937
2749	8.81264	8.74971
2750	4.83326	4.65235
2751	10.0652	10.3287
2752	0.972878	1.24802
2753	0.601506	0.54988
2754	0.325548	0.258469
2755	0.544687	0.545636
2756	9.528	9.69446
2757	5.81947	5.5517
2758	0.359871	0.225248
2759	0.115308	0.221793
2760	2.63772	2.56152
2761	1.96437	1.63108
2762	5.20295	4.63237
2763	0.702144	0.844611
2764	0.445572	0.322042
2765	4.29639	4.34848
2766	0.764313	0.77498
2767	1.44026	2.1916
2768	0.382639	0.221405
2769	0.444157	0.459371
2770	0.251158	0.402785
2771	6.33112	6.40832
2772	10.7057	11.3267
2773	0.24148	0.256479
2774	2.50928	3.20198
2775	6.58767	6.77298
2776	6.56833	6.01297
2777	4.0369	3.5204
2778	0.49617	0.328782
2779	0.694113	0.437173
2780	3.45655	3.10931
2781	2.74968	2.02585
2782	1.83783	1.68733
2783	0.236983	0.262603
2784	0.72623	0.439481
2785	3.43268	3.26695
2786	7.54973	7.3692
2787	0.314155	0.269123
2788	2.11747	2.2907
2789	2.64852	2.4081
2790	5.73618	5.71704
2791	3.35213	3.34878
2792	3.98574	3.33157
2793	2.5956	3.10131
2794	5.26847	4.55958
2795	4.51679	4.39486
2796	0.289895	0.259938
2797	3.99342	3.57534
2798	6.47201	6.55685
2799	2.86881	2.74763
2800	0.42982	0.438556
2801	4.18113	3.86858
2802	0.323048	0.308433
2803	0.188507	0.310986
2804	2.63212	2.54459
2805	0.966489	0.721417
2806	2.50577	2.4081
2807	1.7041	1.70474
2808	0.228526	0.225946
2809	6.32038	5.71983
2810	1.2871	1.84745
2811	3.6844	3.34709
2812	0.174545	0.326083
2813	0.304142	0.431355
2814	0.180718	0.458395
2815	2.32756	3.65349
2816	0.241638	0.232201
2817	0.426549	0.293548
2818	2.33822	2.95012
2819	0.179366	0.221108
2820	0.215349	0.423428
2821	1.15372	1.06337
2822	2.91787	2.57073
2823	0.186857	0.474251
2824	4.72603	4.84161
2825	1.66823	2.50848
2826	2.55146	2.49836
2827	3.3371	4.12372
2828	3.62316	3.64624
2829	0.168316	0.328782
2830	6.93597	6.66566
2831	0.386857	0.229548
2832	0.15098	0.365599
2833	0.73539	0.748858
2834	0.430513	0.234606
2835	5.23306	4.64494
2836	8.97044	8.90893
2837	5.43696	4.80562
2838	5.85418	5.52317
2839	6.60114	6.29189
2840	5.61548	5.02594
2841	0.293683	0.32963
2842	4.97302	4.4989
2843	10.8646	11.509
2844	3.80877	3.28724
2845	2.38738	2.12885
2846	0.451251	0.466527
2847	0.62207	0.580993
2848	6.68136	6.35706
2849	7.98322	7.85239
2850	7.66083	7.19659
2851	0.362362	0.327092
2852	4.36275	3.8172
2853	6.53653	5.9975
2854	0.593271	0.54033
2855	7.78202	7.78792
2856	4.96201	4.83229
2857	6.93706	7.15961
2858	0.565239	0.367298
2859	4.28835	4.11436
2860	0.135455	0.272556
2861	0.165148	0.259536
2862	10.2685	10.5765
2863	2.19368	2.54459
2864	1.18877	1.60444
2865	0.581692	0.652792
2866	0.430663	0.282988
2867	5.63169	5.36598
2868	2.03041	1.85066
2869	9.10487	9.54085
2870	4.96668	4.24663
2871	0.174373	0.313561
2872	2.00274	1.91606
2873	3.72197	3.5204
2874	5.3992	4.92088
2875	7.1957	6.89979
2876	0.49678	0.466287
2877	0.652175	0.619051
2878	2.69585	2.68326
2879	2.51614	2.40963
2880	0.417284	0.422366
2881	1.05392	1.18653
2882	6.50577	6.47608
2883	0.312597	0.269651
2884	0.249644	0.267547
2885	2.49393	2.37605
2886	3.72477	3.39349
2887	2.20213	2.59891
2888	0.28558	0.465775
2889	4.16956	3.53859
2890	0.123784	0.251376
2891	0.116632	0.225364
2892	3.70675	3.82095
2893	2.69845	3.57708
2894	3.85658	3.06161
2895	0.842922	0.919392
2896	3.07121	2.96536
2897	0.445254	0.312754
2898	6.36413	5.89031
2899	4.47496	3.78958
2900	0.757115	0.931453
2901	4.71075	4.81434
2902	4.5195	3.85207
2903	4.04142	3.77011
2904	1.47441	1.15713
2905	1.66846	2.59296
2906	3.92421	3.26035
2907	1.66439	2.64013
2908	2.74399	3.22682
2909	3.64163	3.40598
2910	2.09226	2.66125
2911	2.61316	2.67637
2912	2.87463	2.75472
2913	4.97533	4.29062
2914	1.23727	1.76424
2915	0.997518	1.2576
2916	0.667892	0.742345
2917	2.77217	3.34016
2918	0.661968	0.671556
2919	0.469499	0.511224
2920	1.03794	1.35028
2921	0.168506	0.310986
2922	0.38305	0.269082
2923	4.16182	3.81061
2924	0.131951	0.268376
2925	5.21938	4.48733
2926	4.10324	3.33157
2927	3.48158	4.34848
2928	6.22482	5.67504
2929	6.3625	6.06194
2930	4.98194	4.78028
2931	6.41259	5.85702
2932	4.60713	4.68936
2933	0.60439	0.358695
2934	5.744	4.98658
2935	3.52654	3.16592
2936	5.75158	5.32192
2937	5.52032	5.14399
2938	0.239093	0.253261
2939	4.19663	3.83081
2940	0.442375	0.310186
2941	1.916	2.60562
2942	0.864634	0.860874
2943	0.172945	0.23667
2944	0.119887	0.244101
2945	4.03192	3.59556
2946	1.98667	1.65308
2947	0.145285	0.258069
2948	9.21812	9.5938
2949	0.352669	0.352103
2950	2.20761	2.08243
2951	0.38606	0.271771
2952	2.40988	2.24859
2953	0.111006	0.247138
2954	4.91251	4.1253
2955	0.151139	0.188371
2956	3.94141	3.4933
2957	0.12267	0.282857
2958	6.9229	7.0948
2959	0.339925	0.269651
2960	5.39456	4.76798
2961	2.18384	1.58061
2962	5.13254	4.9478
2963	3.3414	2.95623
2964	2.91337	3.56788
2965	0.121878	0.278375
2966	0.251174	0.399684
2967	5.89844	5.24284
2968	0.296727	0.226879
2969	1.56289	2.66298
2970	8.10075	8.06147
2971	2.29187	2.6902
2972	0.158938	0.23777
2973	0.462609	0.663258
2974	0.768149	0.588833
2975	8.64456	8.51839
2976	4.66031	3.98585
2977	1.35217	2.0121
2978	0.299259	0.297354
2979	2.55955	2.21566
2980	2.08498	2.01302
2981	0.16992	0.189051
2982	4.30088	3.61414
2983	2.15773	2.01669
2984	4.10868	3.61238
2985	0.254447	0.274105
2986	2.34665	2.2244
2987	0.10656	0.221793
2988	2.4511	1.75166
2989	2.7461	2.50152
2990	1.05728	1.2181
2991	3.54187	3.13505
2992	2.65328	2.7041
2993	0.177754	0.248799
2994	0.87348	1.42396
2995	4.98302	4.64038
2996	4.16511	3.64405
2997	2.81298	2.7044
2998	5.67698	4.98724
2999	0.33122	0.249441
3000	5.78669	5.13324
3001	1.87319	2.11596
3002	0.590911	0.715863
3003	8.31489	8.14497
3004	2.01525	1.89994
3005	4.31354	3.72185
3006	5.21605	5.47118
3007	7.89174	7.60551
3008	1.39133	0.984789
3009	4.44924	3.98532
3010	0.199309	0.353011
3011	0.583083	0.594972
3012	0.57553	0.33928
3013	0.770278	0.709986
3014	1.68273	1.27632
3015	0.249514	0.26038
3016	0.489333	0.56329
3017	0.165707	0.188759
3018	5.78843	5.10618
3019	5.2935	4.65692
3020	4.43553	3.91207
3021	5.82959	5.22935
3022	7.97393	7.62804
3023	0.0927011	0.198638
3024	5.11071	4.92088
3025	7.55764	7.66684
3026	6.14971	5.54212
3027	0.15359	0.266859
3028	7.44437	7.10177
3029	0.15279	0.317626
3030	0.148562	0.316972
3031	0.599208	0.407167
3032	4.01043	3.63419
3033	5.54003	5.4543
3034	2.57506	2.55905
3035	0.441433	0.473307
3036	5.2175	5.338
3037	0.0969289	0.217717
3038	1.39297	1.02796
3039	3.60713	3.07044
3040	3.75256	3.17569
3041	5.70668	5.09304
3042	6.50483	6.27246
3043	8.5491	8.56567
3044	7.50664	8.47348
3045	0.243537	0.268458
3046	0.0877899	0.18095
3047	4.76342	4.22424
3048	0.642724	0.607675
3049	2.14274	1.92351
3050	2.23017	1.8576
3051	2.02969	2.38218
3052	3.69697	3.81112
3053	3.70229	3.43794
3054	5.88988	5.82692
3055	1.18279	0.776579
3056	1.06525	1.26086
3057	0.634357	0.772588
3058	4.02949	3.53966
3059	1.08483	0.785027
3060	3.869	3.57708
3061	0.992622	0.924314
3062	1.38838	2.291
3063	3.67752	3.24198
3064	0.139173	0.242596
3065	0.875832	1.02391
3066	4.55033	4.03752
3067	2.46289	1.92559
3068	1.46046	2.21905
3069	6.26923	5.93601
3070	8.27666	8.54036
3071	0.487118	0.437202
3072	9.92881	10.1389
3073	4.51317	4.22424
3074	2.7184	2.69109
3075	0.421327	0.303702
3076	0.367117	0.297354
3077	4.45584	4.83389
3078	0.560368	0.565675
3079	0.230282	0.255647
3080	0.190127	0.39579
3081	0.539313	0.50528
3082	4.97533	4.29062
3083	7.48123	7.72038
3084	0.364997	0.266172
3085	3.73582	3.86053
3086	6.37763	6.31818
3087	0.707429	0.797667
3088	0.361065	0.291138
3089	2.54412	2.26823
3090	1.97228	1.80452
3091	2.5374	3.06161
3092	10.412	10.9762
3093	0.285978	0.216487
3094	0.399918	0.270458
3095	0.163474	0.316808
3096	3.92421	3.26035
3097	4.96103	5.51379
3098	4.44673	4.55377
3099	8.14225	7.81099
3100	6.59769	6.04715
3101	0.458859	0.457215
3102	2.0497	3.07745
3103	0.172822	0.134068
3104	5.26371	5.02746
3105	0.103317	0.200488
3106	2.29593	3.78995
3107	6.33385	5.79697
3108	0.449379	0.48416
3109	0.464967	0.396841
3110	11.1253	11.846
3111	3.95884	3.67184
3112	3.27914	2.93339
3113	4.66948	4.58452
3114	7.34963	6.91758
3115	1.71069	1.40325
3116	1.38172	1.01742
3117	0.33136	0.243097
3118	3.58342	3.5887
3119	0.565989	0.649103
3120	6.25737	6.63052
3121	5.03304	5.02786
3122	0.0920214	0.196297
3123	5.68697	5.0389
3124	4.21453	3.44681
3125	2.00976	2.1723
3126	0.724734	0.795614
3127	0.207523	0.315668
3128	0.828688	1.27584
3129	2.5803	3.22682
3130	1.31465	0.972186
3131	0.0991145	0.216152
3132	1.59546	1.38886
3133	9.55412	9.64464
3134	1.3542	1.00323
3135	6.6865	6.07758
3136	0.54787	0.535884
3137	0.150461	0.243598
3138	2.47411	1.80349
3139	0.111479	0.200076
3140	0.153985	0.348493
3141	0.173463	0.392946
3142	2.42262	4.71542
3143	5.50423	5.06757
3144	0.45873	0.312786
3145	0.0920212	0.177442
3146	2.33698	3.76051
3147	0.809466	1.3521
3148	0.170444	0.190322
3149	3.21239	2.96536
3150	0.639719	0.60202
3151	0.219624	0.21482
3152	4.29075	3.68951
3153	2.09159	2.60562
3154	0.178852	0.336668
3155	0.994539	0.699048
3156	11.4307	12.4595
3157	0.580435	0.678862
3158	4.14146	3.62456
3159	7.53158	7.60551
3160	0.549928	0.625786
3161	3.857	3.33479
3162	0.279668	0.411385
3163	0.126999	0.260608
3164	5.75892	5.55446
3165	2.14626	2.84268
3166	8.56412	8.40937
3167	0.116047	0.249569
3168	7.76275	8.08471
3169	5.159	4.4299
3170	1.73584	1.42952
3171	5.18581	4.45278
3172	0.142546	0.288896
3173	0.367373	0.268376
3174	5.07922	5.58586
3175	5.71781	5.0545
3176	9.90215	10.4089
3177	6.80985	6.91968
3178	2.33177	4.68389
3179	6.08133	5.52859
3180	6.69073	6.30812
3181	0.152806	0.278519
3182	6.26465	6.29055
3183	1.77253	1.39153
3184	0.427764	0.232704
3185	9.3591	9.92698
3186	1.34487	2.00884
3187	0.101463	0.217493
3188	4.87193	4.14716
3189	0.160652	0.250729
3190	0.204859	0.247151
3191	0.299624	0.297814
3192	5.14409	4.9952
3193	5.6147	5.76596
3194	3.69848	3.06803
3195	0.25659	0.277659
3196	6.21873	5.61471
3197	10.0188	10.3287
3198	1.44854	1.16912
3199	1.50236	1.22904
3200	0.832961	0.841945
3201	0.58881	0.662961
3202	2.86689	2.54459
3203	5.87119	5.50897
3204	3.57666	4.2357
3205	0.219009	0.479411
3206	1.22433	1.69307
3207	4.90012	4.19012
3208	2.51885	2.76895
3209	0.568838	0.576563
3210	0.970253	1.06815
3211	0.265206	0.244101
3212	4.99717	4.58252
3213	0.203092	0.250781
3214	6.83515	6.59644
3215	0.195304	0.354835
3216	0.230478	0.255924
3217	2.64447	3.17569
3218	0.301704	0.28756
3219	0.151873	0.314046
3220	4.18527	3.80051
3221	5.69092	5.10686
3222	4.705	4.32391
3223	4.95104	4.30169
3224	6.55258	6.12555
3225	4.53822	3.92269
3226	7.63199	7.25339
3227	0.568254	0.349392
3228	7.21026	6.75556
3229	0.261181	0.214599
3230	10.9808	11.6283
3231	1.11354	1.48128
3232	2.2786	2.8063
3233	9.79822	10.7246
3234	1.95401	2.09967
3235	1.05902	1.3934
3236	8.57873	9.95639
3237	4.1303	3.77125
3238	5.96687	6.15954
3239	1.85815	1.67548
3240	0.190752	0.299815
3241	1.95625	2.23589
3242	0.213651	0.207423
3243	3.23682	2.85148
3244	4.56815	4.32391
3245	2.04266	3.75107
3246	2.45941	2.94253
3247	0.167228	0.326083
3248	3.28084	3.04588
3249	1.15858	1.03579
3250	0.204173	0.308592
3251	0.264409	0.40591
3252	1.08993	1.3934
3253	0.598857	0.742533
3254	5.1032	4.64269
3255	0.113248	0.250084
3256	2.2635	2.56565
3257	0.476272	0.431384
3258	0.248626	0.251493
3259	5.7547	5.66119
3260	3.35174	2.94253
3261	0.163945	0.205086
3262	1.05677	1.38634
3263	0.445749	0.479196
3264	0.98733	0.715815
3265	3.99464	3.6013
3266	2.32489	2.6544
3267	9.25823	9.26949
3268	0.244462	0.268791
3269	0.381996	0.268141
3270	1.70617	2.93707
3271	1.35113	1.00323
3272	6.15732	6.17543
3273	0.393878	0.333754
3274	2.58933	2.54767
3275	0.761149	1.27759
3276	0.892519	0.89341
3277	6.68895	6.66243
3278	1.07925	1.36779
3279	0.354802	0.318445
3280	4.07609	3.9126
3281	5.37227	4.87043
3282	2.69222	4.06047
3283	0.326072	0.269651
3284	0.877733	1.19354
3285	1.37465	1.9319
3286	1.07244	1.21187
3287	0.354153	0.269651
3288	1.04029	1.48041
3289	0.60259	0.582535
3290	0.580451	0.342971
3291	3.84684	3.22526
3292	6.35889	6.66768
3293	6.70273	6.16036
3294	2.66235	2.40422
3295	0.5996	0.729265
3296	4.01085	3.35579
3297	4.4276	3.9126
3298	7.54424	7.23377
3299	2.5457	2.34653
3300	6.15257	5.58586
3301	5.37021	4.7173
3302	3.17524	5.12004
3303	7.96001	7.66744
3304	0.622889	0.702707
3305	0.976257	0.912484
3306	5.96764	5.34099
3307	1.22361	1.03846
3308	0.107259	0.2334
3309	4.84565	4.16858
3310	1.04626	1.23451
3311	0.583413	0.502683
3312	6.65192	6.09407
3313	0.239405	0.357772
3314	3.09736	3.26193
3315	0.13609	0.217381
3316	2.8479	2.64076
3317	0.189632	0.272556
3318	4.48354	3.87049
3319	0.523395	0.540321
3320	0.098036	0.213276
3321	0.942647	0.973208
3322	1.86998	1.66687
3323	1.21198	1.6714
3324	0.360366	0.277659
3325	4.1303	3.71178
3326	2.84201	2.42287
3327	0.474724	0.712136
3328	6.74353	6.97126
3329	1.98927	1.86887
3330	8.62858	8.54363
3331	10.8192	11.4499
3332	7.56277	8.49972
3333	6.84228	6.68285
3334	2.05711	2.55115
3335	0.975643	1.25253
3336	3.15333	4.88299
3337	1.94228	2.935
3338	0.148454	0.306216
3339	0.238754	0.252805
3340	2.28656	2.59891
3341	2.23069	2.10712
3342	0.207796	0.251661
3343	0.856795	0.620927
3344	1.57179	1.28954
3345	2.42441	2.6902
3346	0.851811	0.725144
3347	0.55236	0.353011
3348	2.0081	2.82079
3349	2.88544	2.82807
3350	0.1323	0.315343
3351	0.272103	0.282857
3352	4.87348	4.12372
3353	0.184956	0.265898
3354	0.939756	0.684436
3355	4.64023	4.93357
3356	0.171287	0.132557
3357	0.844134	1.39588
3358	1.96985	2.42678
3359	1.06509	1.20254
3360	1.97827	2.67637
3361	0.457721	0.312786
3362	0.207452	0.214267
3363	3.45686	3.4933
3364	4.63138	4.29005
3365	0.294755	0.265487
3366	0.961627	0.695456
3367	1.44318	2.19726
3368	3.57695	3.17569
3369	0.947126	0.801787
3370	1.38082	1.16311
3371	1.04934	1.05193
3372	3.91637	3.88777
3373	0.260674	0.279813
3374	0.386047	0.229548
3375	0.621016	0.736819
3376	1.38379	2.07207
3377	1.55765	2.34939
3378	2.09443	1.95424
3379	5.20937	4.86978
3380	4.4358	3.67233
3381	4.87307	4.40486
3382	1.37124	2.22194
3383	0.444486	0.477471
3384	8.32871	8.51839
3385	0.415205	0.289642
3386	8.93651	8.86314
3387	2.21041	3.20198
3388	5.56822	4.87043
3389	0.21157	0.251674
3390	2.30772	3.36608
3391	0.260844	0.35575
3392	0.627389	0.587851
3393	5.42418	4.79325
3394	2.41367	2.23958
3395	1.51804	1.06886
3396	6.26583	5.67504
3397	2.3436	2.64076
3398	6.14397	6.76284
3399	0.112438	0.234364
3400	5.40429	4.68098
3401	4.85873	4.64494
3402	0.31377	0.245488
3403	0.590391	0.537
3404	0.277926	0.364283
3405	3.00205	3.03865
3406	0.157588	0.289642
3407	3.44663	3.28382
3408	1.63885	1.45533
3409	0.852748	0.859549
3410	0.434423	0.237317
3411	3.4972	2.85745
3412	8.57719	8.40937
3413	1.18832	0.805929
3414	0.266068	0.245109
3415	0.0903881	0.18692
3416	0.162784	0.297354
3417	0.102718	0.225597
3418	4.37177	3.77011
3419	1.19858	1.1388
3420	0.156059	0.196196
3421	0.447943	0.305901
3422	0.559092	0.73797
3423	7.80849	7.68722
3424	0.112011	0.242097
3425	0.109392	0.234848
3426	3.10376	2.90396
3427	0.398401	0.299815
3428	0.100679	0.206357
3429	0.432646	0.29889
3430	10.256	11.0031
3431	0.173774	0.182354
3432	4.34507	4.29005
3433	3.18027	3.6913
3434	8.84404	8.95837
3435	0.211112	0.23815
3436	0.562047	0.742856
3437	0.110284	0.241349
3438	0.254988	0.345632
3439	0.399556	0.293548
3440	0.997271	0.917198
3441	2.48406	1.77707
3442	1.80115	2.88816
3443	0.603203	0.61587
3444	2.07595	2.62719
3445	10.0617	10.4936
3446	5.11147	4.95674
3447	3.88906	3.35742
3448	4.54854	4.34848
3449	5.19368	4.45278
3450	4.52126	4.07947
3451	4.42312	4.18956
3452	5.76716	5.16173
3453	1.70168	2.64821
3454	2.49508	3.39219
3455	0.133393	0.266309
3456	5.73671	5.16242
3457	0.114653	0.245741
3458	5.40656	4.76862
3459	4.34441	3.67233
3460	0.189582	0.281404
3461	0.163425	0.407167
3462	0.839468	0.711817
3463	2.01331	2.36994
3464	0.230581	0.256069
3465	7.29216	7.10083
3466	1.23217	0.951863
3467	8.00534	7.78792
3468	4.22009	3.98037
3469	6.89101	6.37346
3470	0.462889	0.322241
3471	0.480643	0.429831
3472	3.04926	2.54991
3473	4.06845	3.29571
3474	0.228263	0.256981
3475	0.936872	1.65728
3476	4.52736	4.22263
3477	2.57754	2.32638
3478	6.06615	5.64663
3479	0.632754	0.593703
3480	0.245268	0.25148
3481	1.03714	1.95132
3482	0.830849	1.11636
3483	5.60884	5.16132
3484	0.257354	0.262765
3485	6.85895	6.88203
3486	0.295657	0.248927
3487	0.106077	0.201109
3488	4.3202	3.77983
3489	3.29007	5.45503
3490	4.39902	4.42634
3491	0.572193	0.369196
3492	9.21353	9.46739
3493	0.131815	0.288153
3494	0.532701	0.686438
3495	7.43342	7.27114
3496	0.0974019	0.196399
3497	3.59914	3.19374
3498	0.186852	0.273259
3499	0.207303	0.303702
3500	7.52812	7.57849
3501	6.76717	6.80797
3502	0.359754	0.225155
3503	1.60231	2.56949
3504	0.878654	0.756438
3505	5.60943	5.24284
3506	0.154796	0.165008
3507	2.2347	1.86239
3508	3.52156	2.8413
3509	0.495816	0.50714
3510	0.117619	0.235575
3511	0.250528	0.379026
3512	1.03697	1.3511
3513	0.736722	0.560127
3514	0.638506	0.641456
3515	1.18061	0.776579
3516	1.07303	1.40855
3517	5.9127	5.29917
3518	0.588716	0.516068
3519	3.06892	2.92789
3520	10.7542	11.5685
3521	0.326072	0.269651
3522	3.65317	3.33478
3523	8.50566	8.34032
3524	7.2706	7.52653
3525	6.43661	6.14135
3526	4.48796	4.18956
3527	4.27338	3.50231
3528	3.92455	3.63283
3529	0.642877	0.787052
3530	4.0685	3.70194
3531	2.66408	2.64273
3532	0.837767	0.709986
3533	0.124738	0.243222
3534	3.02022	2.71806
3535	7.27423	7.14119
3536	2.07672	1.59594
3537	2.04227	1.88628
3538	0.137831	0.29889
3539	1.53408	1.21644
3540	1.94449	1.77227
3541	3.19268	2.97301
3542	8.30916	8.10311
3543	3.90869	3.12698
3544	0.759157	0.869307
3545	4.53019	4.82047
3546	6.33688	5.76718
3547	0.822331	1.00136
3548	1.09083	0.992942
3549	0.379788	0.28213
3550	0.701811	0.654476
3551	4.54611	3.88196
3552	0.117442	0.218279
3553	4.93002	4.22263
3554	6.31343	6.3407
3555	2.3201	1.81088
3556	0.427462	0.280318
3557	3.90539	3.11893
3558	2.23249	2.15763
3559	5.56413	5.18909
3560	2.01622	2.63396
3561	0.109656	0.223514
3562	0.171046	0.320255
3563	5.5905	5.21077
3564	1.21443	1.15356
3565	1.44621	2.31219
3566	5.39484	4.94819
3567	0.590281	0.612705
3568	6.05439	5.83622
3569	0.786253	1.07114
3570	4.18658	4.29062
3571	0.560332	0.327936
3572	2.46395	2.34082
3573	0.542018	0.335802
3574	4.38555	3.60484
3575	0.622725	0.620927
3576	8.19119	8.45168
3577	1.92449	1.71727
3578	0.122747	0.249569
3579	0.36897	0.277002
3580	8.90277	8.84034
3581	1.83604	3.25628
3582	0.5915	0.389118
3583	0.940738	0.970701
3584	0.991194	1.27795
3585	5.72783	5.12003
3586	2.34143	3.23515
3587	10.0649	10.7453
3588	4.76899	4.20253
3589	0.375054	0.273513
3590	3.22896	2.84268
3591	0.326675	0.245109
3592	2.92194	2.8736
3593	2.6032	4.98411
3594	2.44106	1.94137
3595	1.59003	1.23602
3596	0.176042	0.332188
3597	1.92404	3.325
3598	0.158935	0.292793
3599	3.25907	3.05843
3600	0.672754	0.745125
3601	0.193687	0.464577
3602	0.514131	0.493987
3603	3.57763	3.44323
3604	2.72036	2.49139
3605	1.79352	3.35861
3606	2.09389	1.91061
3607	0.273435	0.215596
3608	4.70943	4.13594
3609	0.584951	0.546199
3610	0.100625	0.225132
3611	0.146128	0.36241
3612	4.51663	4.1253
3613	0.0992014	0.214488
3614	1.56176	1.07745
3615	0.819219	0.96285
3616	0.65079	0.65718
3617	0.271041	0.31518
3618	0.141512	0.240481
3619	2.76436	2.43755
3620	3.98647	3.46462
3621	0.994165	0.686201
3622	1.86278	1.7829
3623	0.295952	0.266859
3624	1.55002	1.38438
3625	3.37192	3.6818
3626	0.734459	0.709986
3627	5.3325	4.60681
3628	0.45822	0.302655
3629	0.159291	0.169488
3630	4.12102	3.57708
3631	0.942757	0.854246
3632	7.79963	7.70808
3633	1.05151	1.21183
3634	5.06388	4.89559
3635	2.39578	2.08243
3636	5.24681	5.06687
3637	0.365169	0.218718
3638	0.301818	0.274529
3639	2.59531	2.58805
3640	0.239039	0.264777
3641	0.179337	0.291889
3642	3.68902	3.35697
3643	2.06443	1.55857
3644	0.560447	0.363345
3645	0.488401	0.561928
3646	1.54865	1.19716
3647	0.132505	0.311788
3648	1.11971	0.898025
3649	4.06398	3.76822
3650	1.62698	1.31283
3651	9.70012	9.85055
3652	6.96659	6.56254
3653	5.04761	5.63129
3654	0.284124	0.353922
3655	1.72826	1.39872
3656	3.27046	2.98509
3657	8.97437	8.90893
3658	1.20412	1.73641
3659	5.4289	5.0389
3660	4.0051	3.44514
3661	0.653353	0.709986
3662	5.19393	4.69306
3663	1.97865	2.94254
3664	1.00058	1.40897
3665	4.03554	3.76155
3666	0.652442	0.760345
3667	2.26508	3.28724
3668	0.580603	0.649103
3669	0.102549	0.225829
3670	3.40553	3.19374
3671	6.22968	6.2372
3672	0.715023	0.670174
3673	4.56426	4.20763
3674	2.54264	3.39219
3675	1.70515	2.64815
3676	0.657795	0.445357
3677	3.15683	2.78326
3678	3.60151	3.53859
3679	1.15316	0.995503
3680	6.11893	5.85702
3681	0.148866	0.278232
3682	3.59936	2.96392
3683	0.523595	0.667602
3684	0.184166	0.267547
3685	5.71808	5.46644
3686	1.90276	2.43932
3687	9.32097	9.34622
3688	5.46555	4.90822
3689	4.12053	3.68292
3690	6.55185	6.01527
3691	5.90755	5.61642
3692	6.16073	5.78129
3693	0.392017	0.361478
3694	0.258538	0.458395
3695	0.238464	0.252414
3696	7.28297	7.46799
3697	0.837931	1.16139
3698	2.91546	2.58805
3699	6.46924	6.89887
3700	2.99244	3.07743
3701	0.162256	0.300588
3702	0.353278	0.285052
3703	1.28036	0.886075
3704	0.292023	0.516068
3705	2.65633	1.94044
3706	0.670932	0.590352
3707	4.50728	4.62795
3708	2.06438	1.57654
3709	1.83761	1.61852
3710	0.104068	0.209141
3711	4.6379	4.04794
3712	0.235181	0.274105
3713	4.51395	3.94295
3714	0.097402	0.211525
3715	6.69631	6.95332
3716	3.46765	3.3093
3717	5.69839	5.22935
3718	4.69996	4.25668
3719	5.43831	4.84475
3720	0.68959	0.619051
3721	1.01981	1.28049
3722	7.2885	7.50817
3723	10.2012	10.6311
3724	0.757584	0.478177
3725	5.50603	4.79325
3726	3.80358	3.13353
3727	0.671974	0.684482
3728	4.64811	4.25758
3729	2.31652	2.45951
3730	2.87377	4.41622
3731	8.15363	7.83114
3732	0.170791	0.334938
3733	9.49331	9.59507
3734	1.70011	3.09228
3735	0.573262	0.640795
3736	0.252711	0.242721
3737	0.888608	1.01237
3738	3.33985	3.80132
3739	2.80033	2.32264
3740	4.60879	4.3952
3741	0.220079	0.358695
3742	0.161999	0.327261
3743	1.50206	1.22868
3744	0.573201	0.337536
3745	0.155701	0.244604
3746	0.165747	0.278375
3747	0.451937	0.487665
3748	4.67647	4.29062
3749	0.26093	0.263579
3750	0.154106	0.325244
3751	7.70565	7.93267
3752	0.746904	0.682721
3753	2.48808	2.16612
3754	0.124535	0.288153
3755	9.50463	9.71947
3756	10.8394	11.5983
3757	1.84108	1.58061
3758	2.00033	1.58878
3759	3.55317	4.21176
3760	3.79793	4.47578
3761	9.38962	9.8239
3762	2.5018	2.48737
3763	4.26522	4.00444
3764	0.449426	0.327092
3765	1.55227	2.52261
3766	5.75071	6.2219
3767	0.236665	0.333045
3768	0.0999848	0.17427
3769	3.51176	3.29344
3770	4.72237	4.50062
3771	5.91641	5.70685
3772	1.86227	3.40026
3773	5.58654	5.10686
3774	0.728943	0.854805
3775	3.79774	3.26193
3776	6.45798	6.31818
3777	0.565783	0.508719
3778	1.64168	1.41758
3779	0.280575	0.348314
3780	0.230676	0.216152
3781	0.110078	0.21207
3782	0.149345	0.335802
3783	9.1553	9.44303
3784	2.38145	2.00956
3785	0.367021	0.269818
3786	5.93182	5.70685
3787	0.933778	0.693667
3788	6.18389	5.55715
3789	5.02026	4.9478
3790	0.621636	0.754492
3791	0.443368	0.321909
3792	1.41691	1.38438
3793	5.11248	4.40486
3794	2.95504	3.22682
3795	6.81486	7.00939
3796	0.866486	0.700852
3797	5.4451	5.78129
3798	3.41093	2.99762
3799	0.182284	0.135876
3800	1.69824	2.6414
3801	1.30515	0.992942
3802	6.04917	5.42699
3803	4.57148	4.16858
3804	0.565989	0.649103
3805	0.410764	0.279813
3806	0.673253	0.40072
3807	0.579056	0.650777
3808	6.9996	7.27431
3809	0.817344	1.37741
3810	0.720052	0.845605
3811	2.11703	1.45296
3812	2.47968	2.36535
3813	0.171136	0.229347
3814	0.544107	0.531211
3815	0.316921	0.2506
3816	0.204527	0.246642
3817	0.312597	0.269651
3818	0.0993556	0.224784
3819	5.99023	5.49735
3820	4.31798	3.8172
3821	5.06266	4.80745
3822	0.978239	0.734923
3823	5.99495	5.55715
3824	0.104795	0.188856
3825	0.140883	0.244983
3826	0.104706	0.225946
3827	4.76948	4.88234
3828	10.707	11.4794
3829	0.568254	0.349392
3830	5.77442	5.17573
3831	1.80509	3.15514
3832	3.23487	3.08039
3833	4.37465	4.1677
3834	3.05238	4.34848
3835	0.267662	0.40591
3836	1.91302	1.80245
3837	6.03459	6.09407
3838	5.48133	4.78092
3839	1.19654	1.62063
3840	6.05265	5.98435
3841	3.01475	2.95773
3842	4.62978	4.52212
3843	0.470146	0.546526
3844	0.909319	1.01239
3845	4.13777	3.59556
3846	0.970473	1.22121
3847	4.28866	3.75073
3848	0.514617	0.487665
3849	6.97842	6.75556
3850	4.34894	3.64405
3851	6.78243	7.17199
3852	1.03985	1.77713
3853	6.05387	5.64663
3854	3.61317	4.20093
3855	3.86483	3.50058
3856	7.8415	7.72693
3857	9.76592	10.1913
3858	4.46037	4.32522
3859	4.35311	3.65345
3860	1.80891	2.79935
3861	2.39146	2.59223
3862	8.49877	8.31886
3863	5.98263	5.59756
3864	3.6365	3.35742
3865	3.26045	3.26378
3866	2.3019	2.15003
3867	8.56433	8.77111
3868	0.0946284	0.199047
3869	4.76405	4.22263
3870	0.490116	0.336668
3871	2.65102	2.06839
3872	4.00271	3.67587
3873	1.17591	1.82778
3874	1.48207	1.06337
3875	0.196967	0.383149
3876	1.37393	0.94162
3877	0.273304	0.269068
3878	3.27792	3.26193
3879	9.5928	10.0609
3880	3.27999	4.03752
3881	2.25185	2.18465
3882	0.518176	0.491955
3883	5.82926	5.38243
3884	2.60103	3.88247
3885	0.783059	0.970176
3886	1.4775	2.31789
3887	0.809924	0.901555
3888	0.48301	0.530664
3889	0.487605	0.446997
3890	1.77887	3.20793
3891	3.20224	3.04097
3892	0.513924	0.574191
3893	3.94015	3.27719
3894	1.61368	2.4047
3895	0.25006	0.239491
3896	1.94097	1.61523
3897	2.26992	2.13238
3898	0.322656	0.284319
3899	6.45532	6.57947
3900	4.47992	4.46367
3901	9.45286	9.54085
3902	2.12207	3.87528
3903	1.01616	1.06119
3904	6.08649	5.6758
3905	0.746386	0.657857
3906	0.494684	0.351197
3907	0.0969447	0.184909
3908	2.01676	1.85639
3909	0.562645	0.568597
3910	0.153313	0.276374
3911	1.70681	3.04369
3912	5.37699	4.94885
3913	0.3881	0.273597
3914	0.548642	0.319266
3915	4.14523	3.53994
3916	3.11576	3.10131
3917	0.140472	0.335802
3918	1.43416	1.4103
3919	2.46527	2.2609
3920	1.30732	1.88665
3921	6.65982	6.29105
3922	0.467542	0.515515
3923	3.20847	2.79908
3924	0.751044	0.8821
3925	0.146858	0.288896
3926	0.0934464	0.195893
3927	7.41694	7.27211
3928	2.45703	3.10931
3929	6.29395	6.73674
3930	0.310876	0.264804
3931	1.19941	1.04652
3932	0.172735	0.219859
3933	0.527597	0.685551
3934	1.77909	3.23501
3935	6.07008	5.42699
3936	8.7988	8.70026
3937	0.818908	0.646057
3938	4.64055	4.38164
3939	4.26615	3.57708
3940	0.455789	0.338407
3941	0.443603	0.250471
3942	3.90393	3.21852
3943	2.85974	2.809
3944	4.30533	3.77011
3945	7.41319	8.36503
3946	1.10647	1.6067
3947	2.38644	1.85995
3948	2.39123	2.13429
3949	0.137508	0.297047
3950	0.314383	0.288153
3951	0.425578	0.279957
3952	2.03579	1.92457
3953	0.801502	0.746756
3954	6.87474	7.44937
3955	0.185097	0.229583
3956	7.60444	7.66846
3957	0.320895	0.260608
3958	0.0946628	0.190224
3959	0.094322	0.198229
3960	8.81251	9.12609
3961	0.0961004	0.208066
3962	3.8305	3.14972
3963	2.36675	3.71231
3964	2.49386	3.19374
3965	0.457157	0.49421
3966	0.734347	1.18014
3967	1.19927	1.64916
3968	1.2017	1.65341
3969	1.78026	1.63421
3970	4.83189	4.3373
3971	2.39458	1.7378
3972	0.555519	0.344743
3973	0.196901	0.32963
3974	3.84809	3.27878
3975	4.38435	3.6818
3976	0.424741	0.309388
3977	0.111141	0.209356
3978	2.15609	2.57227
3979	3.85695	3.34016
3980	3.48522	3.14313
3981	0.0997658	0.202148
3982	1.62414	2.49292
3983	5.37129	4.88447
3984	2.42746	2.39499
3985	3.36178	3.9126
3986	0.518739	0.581036
3987	5.2474	4.51051
3988	2.367	2.02468
3989	5.4493	5.00835
3990	1.19643	1.64229
3991	4.69449	5.04157
3992	5.44318	5.32887
3993	2.60681	2.59473
3994	4.5168	3.92217
3995	2.79248	2.85148
3996	5.35347	4.63299
3997	0.514723	0.50139
3998	1.75363	2.71258

10. Train Single NN Hybrid Model (Optional)

For comparison, we can also train a hybrid model with a standard feed-forward neural network

hm = constructHybridModel(
    predictors,
    forcing,
    target,
    RbQ10,
    parameters,
    neural_param_names,
    global_param_names,
    hidden_layers = NN, # Neural network architecture
    scale_nn_outputs = true, # Scale neural network outputs
    input_batchnorm = false,   # Apply batch normalization to inputs
);

Train the hybrid model

single_nn_out = train(
    hm,
    df,
    ();
    nepochs = 100,           # Number of training epochs
    batchsize = 128,         # Batch size for training
    opt = RMSProp(0.01),   # Optimizer and learning rate
    monitor_names = [:rb, :Q10], # Parameters to monitor during training
    yscale = identity,       # Scaling for outputs
    shuffleobs = true,
    training_loss = :nseLoss,
    loss_types = [:nse],
    array_type = :DimArray,
    plotting = false,
    show_progress = false,
    model_name = "RbQ10_synthetic_single_nn"
);

┌ Warning: training_loss :nseLoss is not in loss_types [:nse], it won't appear in plots
└ @ EasyHybrid ~/work/EasyHybrid.jl/EasyHybrid.jl/src/config/TrainingConfig.jl:184
[ Info: Plotting disabled.
[ Info: Training outputs will be saved to: /Users/runner/work/EasyHybrid.jl/EasyHybrid.jl/docs/build
[ Info: Returning best model from epoch 100 with validation loss: 0.99714035

Close enough

out_lstm.best_loss
single_nn_out.best_loss

0.99714035f0