Wednesday, July 27, 2022

[SOLVED] How and where can I check Keras Tuner output?

Issue

I have executed the Keras tuner, saw the output on the console, and then closed the console.

Now, I want to see the output again.

Where can I see it from, and how?


Solution

Log console output from the start

Typical command would be:

python mytuner.py | tee -a console.log

The -a will write in append mode. Without -a will overwrite the existing console.log file.

Check existing logs

If you can access the tuner search, check what is in the callback. Perhaps CSVLogger is defined there. Check the contents of the csv file. Probably not the complete log as in the console is in there.

tuner.search(
    train_features,
    train_labels,
    epochs=100,
    batch_size=BATCH_SIZE,
    validation_data=(val_features, val_labels),
    callbacks=[tf.keras.callbacks.CSVLogger('e:/ktuner/mylog.csv', separator=",", append=False)],
)

Check log via tensorboard

If you can access the tuner search, check the tensorboard callback.

tuner.search(
    train_features,
    train_labels,
    epochs=100,
    batch_size=BATCH_SIZE,
    validation_data=(val_features, val_labels),
    callbacks=[keras.callbacks.TensorBoard("e:/ktuner/logs")]
)

Install tensorboard then send the command:

tensorboard --logdir e:/ktuner/logs

In the tensorboard GUI there is an option to show download link. You can download csv or json file from different metric monitors. The logs here may not be the same as in the console logs.

enter image description here



Answered By - ferdy
Answer Checked By - David Goodson (WPSolving Volunteer)