官网实例详解4.37（pretrained_word_embeddings.py）-keras学习笔记四
2024-06-07 20:04:55
预训练词嵌入（向量）
脚本加载预处理的词向量（GloVe embeddings）加载到冻结的Keras嵌入层中，并基于20 Newsgroup数据集使用它来训练文本分类模型。
（把newsgroup消息分为20个类别）
newsgroup，20newsgroups数据集是用于文本分类、文本挖据和信息检索研究的国际标准数据集之一。数据集收集了大约20,000左右的新闻组文档，均匀分为20个不同主题的新闻组集合。一些新闻组的主题特别相似(e.g. comp.sys.ibm.pc.hardware/ comp.sys.mac.hardware)，还有一些却完全不相关 (e.g misc.forsale /soc.religion.christian)。
如何理解
Embedding的作用，转换一个文本句子为（神经网络）容易处理的一个数据样本（矩阵是该样本的数据表现形式）。
可以理解Embedding处理后输出的数据，为一张单通道的图，后续的卷积操作类似处理一张图，期望获取图片（文本句子）的分类。
词向量是训练神经网络时候的隐藏层参数或者说矩阵。
意义：词向量降维，例如用one-hot编码20000个词的词汇表，需用20000x20000的矩阵表示，通过降维20000个词的词汇表可以20000x100（还可以取值200,1000）的矩阵表示
Keras实例目录
代码注释
'''This script loads pre-trained word embeddings (GloVe embeddings)
into a frozen Keras Embedding layer, and uses it to
train a text classification model on the 20 Newsgroup dataset
(classification of newsgroup messages into 20 different categories).
脚本加载预处理的词向量（GloVe embeddings）加载到冻结的Keras嵌入层中，并基于20 Newsgroup数据集使用它来训练文本分类模型。
（把newsgroup消息分为20个类别）GloVe embedding data can be found at:
数据见：
http://nlp.stanford.edu/data/glove.6B.zip
(source page: http://nlp.stanford.edu/projects/glove/)
(下载见: http://nlp.stanford.edu/projects/glove/)20 Newsgroup data can be found at:
20 Newsgroup （数据集）下载见:
http://www.cs.cmu.edu/afs/cs.cmu.edu/project/theo-20/www/data/news20.html
'''from __future__ import print_functionimport os
import sys
import numpy as np
from keras.preprocessing.text import Tokenizer
from keras.preprocessing.sequence import pad_sequences
from keras.utils import to_categorical
from keras.layers import Dense, Input, GlobalMaxPooling1D
from keras.layers import Conv1D, MaxPooling1D, Embedding
from keras.models import ModelBASE_DIR = ''
GLOVE_DIR = os.path.join(BASE_DIR, 'glove.6B')
TEXT_DATA_DIR = os.path.join(BASE_DIR, '20_newsgroup')
MAX_SEQUENCE_LENGTH = 1000
MAX_NUM_WORDS = 20000
EMBEDDING_DIM = 100
VALIDATION_SPLIT = 0.2# first, build index mapping words in the embeddings set
# to their embedding vector
# 首先，在嵌入到其嵌入向量中的索引中建立索引映射。print('Indexing word vectors.')embeddings_index = {}
with open(os.path.join(GLOVE_DIR, 'glove.6B.100d.txt')) as f:for line in f:values = line.split()word = values[0]coefs = np.asarray(values[1:], dtype='float32')embeddings_index[word] = coefsprint('Found %s word vectors.' % len(embeddings_index))# second, prepare text samples and their labels
# 第二步，准备文本样本和对应标签
print('Processing text dataset')texts = [] # list of text samples # 文本样本列表
labels_index = {} # dictionary mapping label name to numeric id # 标签名和编号映射到词典
labels = [] # list of label ids # 标签编号列表
for name in sorted(os.listdir(TEXT_DATA_DIR)):path = os.path.join(TEXT_DATA_DIR, name)if os.path.isdir(path):label_id = len(labels_index)labels_index[name] = label_idfor fname in sorted(os.listdir(path)):if fname.isdigit():fpath = os.path.join(path, fname)args = {} if sys.version_info < (3,) else {'encoding': 'latin-1'}with open(fpath, **args) as f:t = f.read()i = t.find('\n\n') # skip headerif 0 < i:t = t[i:]texts.append(t)labels.append(label_id)print('Found %s texts.' % len(texts))# finally, vectorize the text samples into a 2D integer tensor
# 最后，将文本样本向量化为二维整数张量。
tokenizer = Tokenizer(num_words=MAX_NUM_WORDS)
tokenizer.fit_on_texts(texts)
sequences = tokenizer.texts_to_sequences(texts)word_index = tokenizer.word_index
print('Found %s unique tokens.' % len(word_index))data = pad_sequences(sequences, maxlen=MAX_SEQUENCE_LENGTH)labels = to_categorical(np.asarray(labels))
print('Shape of data tensor:', data.shape)
print('Shape of label tensor:', labels.shape)# split the data into a training set and a validation set
# 分割数据集为训练和验证集
indices = np.arange(data.shape[0])
np.random.shuffle(indices)
data = data[indices]
labels = labels[indices]
num_validation_samples = int(VALIDATION_SPLIT * data.shape[0])x_train = data[:-num_validation_samples]
y_train = labels[:-num_validation_samples]
x_val = data[-num_validation_samples:]
y_val = labels[-num_validation_samples:]print('Preparing embedding matrix.')# prepare embedding matrix
# 准备嵌入矩阵
num_words = min(MAX_NUM_WORDS, len(word_index))
embedding_matrix = np.zeros((num_words, EMBEDDING_DIM))
for word, i in word_index.items():if i >= MAX_NUM_WORDS:continueembedding_vector = embeddings_index.get(word)if embedding_vector is not None:# words not found in embedding index will be all-zeros.# 嵌入索引中找不到的词设置为全零。embedding_matrix[i] = embedding_vector# load pre-trained word embeddings into an Embedding layer
# note that we set trainable = False so as to keep the embeddings fixed
# 将预先训练的单词嵌入到嵌入层中，注意我们设置trainable= false，以便保持嵌入固定。
embedding_layer = Embedding(num_words,EMBEDDING_DIM,weights=[embedding_matrix],input_length=MAX_SEQUENCE_LENGTH,trainable=False)print('Training model.')# train a 1D convnet with global maxpooling
# 用全局最大池技术训练1D卷积网络
sequence_input = Input(shape=(MAX_SEQUENCE_LENGTH,), dtype='int32')
embedded_sequences = embedding_layer(sequence_input)
x = Conv1D(128, 5, activation='relu')(embedded_sequences)
x = MaxPooling1D(5)(x)
x = Conv1D(128, 5, activation='relu')(x)
x = MaxPooling1D(5)(x)
x = Conv1D(128, 5, activation='relu')(x)
x = GlobalMaxPooling1D()(x)
x = Dense(128, activation='relu')(x)
preds = Dense(len(labels_index), activation='softmax')(x)model = Model(sequence_input, preds)
model.compile(loss='categorical_crossentropy',optimizer='rmsprop',metrics=['acc'])model.fit(x_train, y_train,batch_size=128,epochs=10,validation_data=(x_val, y_val))
代码执行
C:\ProgramData\Anaconda3\python.exe E:/keras-master/examples/pretrained_word_embeddings.py
Using TensorFlow backend.
Indexing word vectors.
Found 400000 word vectors.
Processing text dataset
Found 19997 texts.
Found 174074 unique tokens.
Shape of data tensor: (19997, 1000)
Shape of label tensor: (19997, 20)
Preparing embedding matrix.
Training model.Train on 15998 samples, validate on 3999 samples
Epoch 1/10128/15998 [..............................] - ETA: 32:55 - loss: 3.1098 - acc: 0.0469256/15998 [..............................] - ETA: 16:41 - loss: 3.2085 - acc: 0.0469384/15998 [..............................] - ETA: 11:15 - loss: 3.1529 - acc: 0.0417512/15998 [..............................] - ETA: 8:24 - loss: 3.1132 - acc: 0.0430 640/15998 [>.............................] - ETA: 6:41 - loss: 3.0965 - acc: 0.0453768/15998 [>.............................] - ETA: 5:33 - loss: 3.0816 - acc: 0.0469896/15998 [>.............................] - ETA: 4:44 - loss: 3.0671 - acc: 0.05021024/15998 [>.............................] - ETA: 4:07 - loss: 3.0576 - acc: 0.04981152/15998 [=>............................] - ETA: 3:39 - loss: 3.0455 - acc: 0.05641280/15998 [=>............................] - ETA: 3:16 - loss: 3.0401 - acc: 0.06021408/15998 [=>............................] - ETA: 2:57 - loss: 3.0322 - acc: 0.05971536/15998 [=>............................] - ETA: 2:41 - loss: 3.0261 - acc: 0.06181664/15998 [==>...........................] - ETA: 2:28 - loss: 3.0204 - acc: 0.06371792/15998 [==>...........................] - ETA: 2:17 - loss: 3.0159 - acc: 0.06251920/15998 [==>...........................] - ETA: 2:07 - loss: 3.0157 - acc: 0.06202048/15998 [==>...........................] - ETA: 1:58 - loss: 3.0117 - acc: 0.06202176/15998 [===>..........................] - ETA: 1:51 - loss: 3.0060 - acc: 0.06572304/15998 [===>..........................] - ETA: 1:44 - loss: 3.0020 - acc: 0.06512432/15998 [===>..........................] - ETA: 1:38 - loss: 3.0055 - acc: 0.06412560/15998 [===>..........................] - ETA: 1:32 - loss: 3.0018 - acc: 0.06452688/15998 [====>.........................] - ETA: 1:27 - loss: 2.9975 - acc: 0.06622816/15998 [====>.........................] - ETA: 1:23 - loss: 2.9935 - acc: 0.06682944/15998 [====>.........................] - ETA: 1:19 - loss: 2.9897 - acc: 0.07303072/15998 [====>.........................] - ETA: 1:15 - loss: 2.9839 - acc: 0.07453200/15998 [=====>........................] - ETA: 1:12 - loss: 2.9813 - acc: 0.07413328/15998 [=====>........................] - ETA: 1:08 - loss: 2.9726 - acc: 0.07663456/15998 [=====>........................] - ETA: 1:05 - loss: 2.9633 - acc: 0.08103584/15998 [=====>........................] - ETA: 1:03 - loss: 2.9538 - acc: 0.08263712/15998 [=====>........................] - ETA: 1:00 - loss: 2.9640 - acc: 0.08193840/15998 [======>.......................] - ETA: 58s - loss: 2.9641 - acc: 0.0823 3968/15998 [======>.......................] - ETA: 55s - loss: 2.9625 - acc: 0.08274096/15998 [======>.......................] - ETA: 53s - loss: 2.9578 - acc: 0.08504224/15998 [======>.......................] - ETA: 51s - loss: 2.9501 - acc: 0.08714352/15998 [=======>......................] - ETA: 49s - loss: 2.9443 - acc: 0.08824480/15998 [=======>......................] - ETA: 47s - loss: 2.9351 - acc: 0.09044608/15998 [=======>......................] - ETA: 46s - loss: 2.9300 - acc: 0.09114736/15998 [=======>......................] - ETA: 44s - loss: 2.9181 - acc: 0.09334864/15998 [========>.....................] - ETA: 43s - loss: 2.9076 - acc: 0.09664992/15998 [========>.....................] - ETA: 41s - loss: 2.9027 - acc: 0.09785120/15998 [========>.....................] - ETA: 40s - loss: 2.9011 - acc: 0.09775248/15998 [========>.....................] - ETA: 39s - loss: 2.8930 - acc: 0.10005376/15998 [=========>....................] - ETA: 37s - loss: 2.8906 - acc: 0.09955504/15998 [=========>....................] - ETA: 36s - loss: 2.8808 - acc: 0.10145632/15998 [=========>....................] - ETA: 35s - loss: 2.8685 - acc: 0.10555760/15998 [=========>....................] - ETA: 34s - loss: 2.8574 - acc: 0.10785888/15998 [==========>...................] - ETA: 33s - loss: 2.8443 - acc: 0.11016016/15998 [==========>...................] - ETA: 32s - loss: 2.8420 - acc: 0.11076144/15998 [==========>...................] - ETA: 31s - loss: 2.8493 - acc: 0.10946272/15998 [==========>...................] - ETA: 30s - loss: 2.8443 - acc: 0.11146400/15998 [===========>..................] - ETA: 29s - loss: 2.8354 - acc: 0.11286528/15998 [===========>..................] - ETA: 28s - loss: 2.8252 - acc: 0.11586656/15998 [===========>..................] - ETA: 27s - loss: 2.8177 - acc: 0.11736784/15998 [===========>..................] - ETA: 26s - loss: 2.8059 - acc: 0.12076912/15998 [===========>..................] - ETA: 26s - loss: 2.7951 - acc: 0.12337040/15998 [============>.................] - ETA: 25s - loss: 2.7883 - acc: 0.12477168/15998 [============>.................] - ETA: 24s - loss: 2.7834 - acc: 0.12517296/15998 [============>.................] - ETA: 23s - loss: 2.7819 - acc: 0.12587424/15998 [============>.................] - ETA: 23s - loss: 2.7761 - acc: 0.12657552/15998 [=============>................] - ETA: 22s - loss: 2.7665 - acc: 0.13027680/15998 [=============>................] - ETA: 21s - loss: 2.7548 - acc: 0.13277808/15998 [=============>................] - ETA: 21s - loss: 2.7447 - acc: 0.13407936/15998 [=============>................] - ETA: 20s - loss: 2.7368 - acc: 0.13618064/15998 [==============>...............] - ETA: 20s - loss: 2.7281 - acc: 0.13818192/15998 [==============>...............] - ETA: 19s - loss: 2.7196 - acc: 0.13998320/15998 [==============>...............] - ETA: 19s - loss: 2.7146 - acc: 0.14038448/15998 [==============>...............] - ETA: 18s - loss: 2.7068 - acc: 0.14168576/15998 [===============>..............] - ETA: 17s - loss: 2.7001 - acc: 0.14248704/15998 [===============>..............] - ETA: 17s - loss: 2.6940 - acc: 0.14408832/15998 [===============>..............] - ETA: 16s - loss: 2.6918 - acc: 0.14458960/15998 [===============>..............] - ETA: 16s - loss: 2.6899 - acc: 0.14499088/15998 [================>.............] - ETA: 15s - loss: 2.6861 - acc: 0.14609216/15998 [================>.............] - ETA: 15s - loss: 2.6791 - acc: 0.14779344/15998 [================>.............] - ETA: 15s - loss: 2.6708 - acc: 0.15019472/15998 [================>.............] - ETA: 14s - loss: 2.6647 - acc: 0.15149600/15998 [=================>............] - ETA: 14s - loss: 2.6623 - acc: 0.15119728/15998 [=================>............] - ETA: 13s - loss: 2.6562 - acc: 0.15169856/15998 [=================>............] - ETA: 13s - loss: 2.6482 - acc: 0.15379984/15998 [=================>............] - ETA: 12s - loss: 2.6408 - acc: 0.1553
10112/15998 [=================>............] - ETA: 12s - loss: 2.6343 - acc: 0.1564
10240/15998 [==================>...........] - ETA: 12s - loss: 2.6267 - acc: 0.1586
10368/15998 [==================>...........] - ETA: 11s - loss: 2.6198 - acc: 0.1593
10496/15998 [==================>...........] - ETA: 11s - loss: 2.6140 - acc: 0.1602
10624/15998 [==================>...........] - ETA: 11s - loss: 2.6092 - acc: 0.1611
10752/15998 [===================>..........] - ETA: 10s - loss: 2.6014 - acc: 0.1634
10880/15998 [===================>..........] - ETA: 10s - loss: 2.5938 - acc: 0.1649
11008/15998 [===================>..........] - ETA: 9s - loss: 2.5868 - acc: 0.1662
11136/15998 [===================>..........] - ETA: 9s - loss: 2.5801 - acc: 0.1677
11264/15998 [====================>.........] - ETA: 9s - loss: 2.5771 - acc: 0.1683
11392/15998 [====================>.........] - ETA: 8s - loss: 2.5748 - acc: 0.1692
11520/15998 [====================>.........] - ETA: 8s - loss: 2.5692 - acc: 0.1702
11648/15998 [====================>.........] - ETA: 8s - loss: 2.5606 - acc: 0.1720
11776/15998 [=====================>........] - ETA: 8s - loss: 2.5530 - acc: 0.1738
11904/15998 [=====================>........] - ETA: 7s - loss: 2.5455 - acc: 0.1752
12032/15998 [=====================>........] - ETA: 7s - loss: 2.5404 - acc: 0.1764
12160/15998 [=====================>........] - ETA: 7s - loss: 2.5376 - acc: 0.1771
12288/15998 [======================>.......] - ETA: 6s - loss: 2.5337 - acc: 0.1777
12416/15998 [======================>.......] - ETA: 6s - loss: 2.5302 - acc: 0.1784
12544/15998 [======================>.......] - ETA: 6s - loss: 2.5253 - acc: 0.1797
12672/15998 [======================>.......] - ETA: 5s - loss: 2.5181 - acc: 0.1818
12800/15998 [=======================>......] - ETA: 5s - loss: 2.5119 - acc: 0.1830
12928/15998 [=======================>......] - ETA: 5s - loss: 2.5054 - acc: 0.1844
13056/15998 [=======================>......] - ETA: 5s - loss: 2.5011 - acc: 0.1853
13184/15998 [=======================>......] - ETA: 4s - loss: 2.4940 - acc: 0.1874
13312/15998 [=======================>......] - ETA: 4s - loss: 2.4864 - acc: 0.1888
13440/15998 [========================>.....] - ETA: 4s - loss: 2.4793 - acc: 0.1908
13568/15998 [========================>.....] - ETA: 4s - loss: 2.4769 - acc: 0.1914
13696/15998 [========================>.....] - ETA: 3s - loss: 2.4741 - acc: 0.1921
13824/15998 [========================>.....] - ETA: 3s - loss: 2.4691 - acc: 0.1930
13952/15998 [=========================>....] - ETA: 3s - loss: 2.4643 - acc: 0.1946
14080/15998 [=========================>....] - ETA: 3s - loss: 2.4592 - acc: 0.1960
14208/15998 [=========================>....] - ETA: 2s - loss: 2.4536 - acc: 0.1978
14336/15998 [=========================>....] - ETA: 2s - loss: 2.4481 - acc: 0.1988
14464/15998 [==========================>...] - ETA: 2s - loss: 2.4416 - acc: 0.2006
14592/15998 [==========================>...] - ETA: 2s - loss: 2.4372 - acc: 0.2019
14720/15998 [==========================>...] - ETA: 2s - loss: 2.4326 - acc: 0.2029
14848/15998 [==========================>...] - ETA: 1s - loss: 2.4289 - acc: 0.2041
14976/15998 [===========================>..] - ETA: 1s - loss: 2.4271 - acc: 0.2042
15104/15998 [===========================>..] - ETA: 1s - loss: 2.4224 - acc: 0.2050
15232/15998 [===========================>..] - ETA: 1s - loss: 2.4179 - acc: 0.2060
15360/15998 [===========================>..] - ETA: 1s - loss: 2.4131 - acc: 0.2074
15488/15998 [============================>.] - ETA: 0s - loss: 2.4102 - acc: 0.2078
15616/15998 [============================>.] - ETA: 0s - loss: 2.4054 - acc: 0.2086
15744/15998 [============================>.] - ETA: 0s - loss: 2.4002 - acc: 0.2100
15872/15998 [============================>.] - ETA: 0s - loss: 2.3943 - acc: 0.2116
15998/15998 [==============================] - 26s 2ms/step - loss: 2.3898 - acc: 0.2123 - val_loss: 1.7477 - val_acc: 0.3823
Epoch 2/10128/15998 [..............................] - ETA: 8s - loss: 1.6620 - acc: 0.4062256/15998 [..............................] - ETA: 7s - loss: 1.7487 - acc: 0.3594384/15998 [..............................] - ETA: 7s - loss: 1.7182 - acc: 0.3958512/15998 [..............................] - ETA: 7s - loss: 1.7241 - acc: 0.4023640/15998 [>.............................] - ETA: 7s - loss: 1.7688 - acc: 0.3937768/15998 [>.............................] - ETA: 7s - loss: 1.7636 - acc: 0.3945896/15998 [>.............................] - ETA: 7s - loss: 1.7401 - acc: 0.39961024/15998 [>.............................] - ETA: 7s - loss: 1.7441 - acc: 0.39651152/15998 [=>............................] - ETA: 7s - loss: 1.7653 - acc: 0.39061280/15998 [=>............................] - ETA: 7s - loss: 1.8064 - acc: 0.37971408/15998 [=>............................] - ETA: 7s - loss: 1.8022 - acc: 0.38211536/15998 [=>............................] - ETA: 7s - loss: 1.7899 - acc: 0.38671664/15998 [==>...........................] - ETA: 7s - loss: 1.7781 - acc: 0.39001792/15998 [==>...........................] - ETA: 7s - loss: 1.7576 - acc: 0.39841920/15998 [==>...........................] - ETA: 7s - loss: 1.7501 - acc: 0.40162048/15998 [==>...........................] - ETA: 7s - loss: 1.7421 - acc: 0.40282176/15998 [===>..........................] - ETA: 6s - loss: 1.7410 - acc: 0.40072304/15998 [===>..........................] - ETA: 6s - loss: 1.7521 - acc: 0.39932432/15998 [===>..........................] - ETA: 6s - loss: 1.7504 - acc: 0.40132560/15998 [===>..........................] - ETA: 6s - loss: 1.7501 - acc: 0.40002688/15998 [====>.........................] - ETA: 6s - loss: 1.7516 - acc: 0.39662816/15998 [====>.........................] - ETA: 6s - loss: 1.7508 - acc: 0.39602944/15998 [====>.........................] - ETA: 6s - loss: 1.7528 - acc: 0.39443072/15998 [====>.........................] - ETA: 6s - loss: 1.7477 - acc: 0.39683200/15998 [=====>........................] - ETA: 6s - loss: 1.7423 - acc: 0.39913328/15998 [=====>........................] - ETA: 6s - loss: 1.7402 - acc: 0.39933456/15998 [=====>........................] - ETA: 6s - loss: 1.7300 - acc: 0.40393584/15998 [=====>........................] - ETA: 6s - loss: 1.7237 - acc: 0.40603712/15998 [=====>........................] - ETA: 6s - loss: 1.7198 - acc: 0.40623840/15998 [======>.......................] - ETA: 6s - loss: 1.7178 - acc: 0.40573968/15998 [======>.......................] - ETA: 6s - loss: 1.7100 - acc: 0.40804096/15998 [======>.......................] - ETA: 5s - loss: 1.7184 - acc: 0.40554224/15998 [======>.......................] - ETA: 5s - loss: 1.7255 - acc: 0.40204352/15998 [=======>......................] - ETA: 5s - loss: 1.7212 - acc: 0.40284480/15998 [=======>......................] - ETA: 5s - loss: 1.7253 - acc: 0.40274608/15998 [=======>......................] - ETA: 5s - loss: 1.7207 - acc: 0.40474736/15998 [=======>......................] - ETA: 5s - loss: 1.7193 - acc: 0.40434864/15998 [========>.....................] - ETA: 5s - loss: 1.7202 - acc: 0.40444992/15998 [========>.....................] - ETA: 5s - loss: 1.7179 - acc: 0.40425120/15998 [========>.....................] - ETA: 5s - loss: 1.7108 - acc: 0.40705248/15998 [========>.....................] - ETA: 5s - loss: 1.7055 - acc: 0.40995376/15998 [=========>....................] - ETA: 5s - loss: 1.7013 - acc: 0.41135504/15998 [=========>....................] - ETA: 5s - loss: 1.7034 - acc: 0.41065632/15998 [=========>....................] - ETA: 5s - loss: 1.7017 - acc: 0.40965760/15998 [=========>....................] - ETA: 5s - loss: 1.7021 - acc: 0.41025888/15998 [==========>...................] - ETA: 5s - loss: 1.6988 - acc: 0.41006016/15998 [==========>...................] - ETA: 4s - loss: 1.7006 - acc: 0.40976144/15998 [==========>...................] - ETA: 4s - loss: 1.6999 - acc: 0.41066272/15998 [==========>...................] - ETA: 4s - loss: 1.7014 - acc: 0.41046400/15998 [===========>..................] - ETA: 4s - loss: 1.6946 - acc: 0.41366528/15998 [===========>..................] - ETA: 4s - loss: 1.6906 - acc: 0.41396656/15998 [===========>..................] - ETA: 4s - loss: 1.6892 - acc: 0.41426784/15998 [===========>..................] - ETA: 4s - loss: 1.6846 - acc: 0.41586912/15998 [===========>..................] - ETA: 4s - loss: 1.6818 - acc: 0.41627040/15998 [============>.................] - ETA: 4s - loss: 1.6780 - acc: 0.41657168/15998 [============>.................] - ETA: 4s - loss: 1.6792 - acc: 0.41647296/15998 [============>.................] - ETA: 4s - loss: 1.6818 - acc: 0.41697424/15998 [============>.................] - ETA: 4s - loss: 1.6827 - acc: 0.41697552/15998 [=============>................] - ETA: 4s - loss: 1.6813 - acc: 0.41797680/15998 [=============>................] - ETA: 4s - loss: 1.6772 - acc: 0.41947808/15998 [=============>................] - ETA: 4s - loss: 1.6733 - acc: 0.42127936/15998 [=============>................] - ETA: 4s - loss: 1.6698 - acc: 0.42288064/15998 [==============>...............] - ETA: 3s - loss: 1.6672 - acc: 0.42378192/15998 [==============>...............] - ETA: 3s - loss: 1.6623 - acc: 0.42538320/15998 [==============>...............] - ETA: 3s - loss: 1.6591 - acc: 0.42668448/15998 [==============>...............] - ETA: 3s - loss: 1.6554 - acc: 0.42768576/15998 [===============>..............] - ETA: 3s - loss: 1.6533 - acc: 0.42838704/15998 [===============>..............] - ETA: 3s - loss: 1.6528 - acc: 0.42858832/15998 [===============>..............] - ETA: 3s - loss: 1.6555 - acc: 0.42848960/15998 [===============>..............] - ETA: 3s - loss: 1.6544 - acc: 0.42859088/15998 [================>.............] - ETA: 3s - loss: 1.6532 - acc: 0.42839216/15998 [================>.............] - ETA: 3s - loss: 1.6532 - acc: 0.42829344/15998 [================>.............] - ETA: 3s - loss: 1.6505 - acc: 0.42959472/15998 [================>.............] - ETA: 3s - loss: 1.6461 - acc: 0.43069600/15998 [=================>............] - ETA: 3s - loss: 1.6492 - acc: 0.42969728/15998 [=================>............] - ETA: 3s - loss: 1.6492 - acc: 0.42939856/15998 [=================>............] - ETA: 3s - loss: 1.6472 - acc: 0.42979984/15998 [=================>............] - ETA: 3s - loss: 1.6463 - acc: 0.4300
10112/15998 [=================>............] - ETA: 2s - loss: 1.6429 - acc: 0.4314
10240/15998 [==================>...........] - ETA: 2s - loss: 1.6405 - acc: 0.4318
10368/15998 [==================>...........] - ETA: 2s - loss: 1.6397 - acc: 0.4324
10496/15998 [==================>...........] - ETA: 2s - loss: 1.6390 - acc: 0.4329
10624/15998 [==================>...........] - ETA: 2s - loss: 1.6401 - acc: 0.4328
10752/15998 [===================>..........] - ETA: 2s - loss: 1.6384 - acc: 0.4328
10880/15998 [===================>..........] - ETA: 2s - loss: 1.6386 - acc: 0.4336
11008/15998 [===================>..........] - ETA: 2s - loss: 1.6379 - acc: 0.4344
11136/15998 [===================>..........] - ETA: 2s - loss: 1.6335 - acc: 0.4362
11264/15998 [====================>.........] - ETA: 2s - loss: 1.6288 - acc: 0.4387
11392/15998 [====================>.........] - ETA: 2s - loss: 1.6255 - acc: 0.4403
11520/15998 [====================>.........] - ETA: 2s - loss: 1.6202 - acc: 0.4424
11648/15998 [====================>.........] - ETA: 2s - loss: 1.6169 - acc: 0.4425
11776/15998 [=====================>........] - ETA: 2s - loss: 1.6173 - acc: 0.4424
11904/15998 [=====================>........] - ETA: 2s - loss: 1.6200 - acc: 0.4421
12032/15998 [=====================>........] - ETA: 1s - loss: 1.6193 - acc: 0.4423
12160/15998 [=====================>........] - ETA: 1s - loss: 1.6171 - acc: 0.4428
12288/15998 [======================>.......] - ETA: 1s - loss: 1.6171 - acc: 0.4430
12416/15998 [======================>.......] - ETA: 1s - loss: 1.6146 - acc: 0.4441
12544/15998 [======================>.......] - ETA: 1s - loss: 1.6141 - acc: 0.4448
12672/15998 [======================>.......] - ETA: 1s - loss: 1.6121 - acc: 0.4451
12800/15998 [=======================>......] - ETA: 1s - loss: 1.6069 - acc: 0.4470
12928/15998 [=======================>......] - ETA: 1s - loss: 1.6038 - acc: 0.4482
13056/15998 [=======================>......] - ETA: 1s - loss: 1.6011 - acc: 0.4494
13184/15998 [=======================>......] - ETA: 1s - loss: 1.6006 - acc: 0.4496
13312/15998 [=======================>......] - ETA: 1s - loss: 1.5999 - acc: 0.4494
13440/15998 [========================>.....] - ETA: 1s - loss: 1.5962 - acc: 0.4501
13568/15998 [========================>.....] - ETA: 1s - loss: 1.5932 - acc: 0.4511
13696/15998 [========================>.....] - ETA: 1s - loss: 1.5911 - acc: 0.4518
13824/15998 [========================>.....] - ETA: 1s - loss: 1.5890 - acc: 0.4522
13952/15998 [=========================>....] - ETA: 1s - loss: 1.5907 - acc: 0.4518
14080/15998 [=========================>....] - ETA: 0s - loss: 1.5888 - acc: 0.4523
14208/15998 [=========================>....] - ETA: 0s - loss: 1.5878 - acc: 0.4526
14336/15998 [=========================>....] - ETA: 0s - loss: 1.5861 - acc: 0.4532
14464/15998 [==========================>...] - ETA: 0s - loss: 1.5829 - acc: 0.4543
14592/15998 [==========================>...] - ETA: 0s - loss: 1.5818 - acc: 0.4548
14720/15998 [==========================>...] - ETA: 0s - loss: 1.5797 - acc: 0.4552
14848/15998 [==========================>...] - ETA: 0s - loss: 1.5787 - acc: 0.4555
14976/15998 [===========================>..] - ETA: 0s - loss: 1.5748 - acc: 0.4568
15104/15998 [===========================>..] - ETA: 0s - loss: 1.5722 - acc: 0.4579
15232/15998 [===========================>..] - ETA: 0s - loss: 1.5694 - acc: 0.4586
15360/15998 [===========================>..] - ETA: 0s - loss: 1.5660 - acc: 0.4598
15488/15998 [============================>.] - ETA: 0s - loss: 1.5645 - acc: 0.4604
15616/15998 [============================>.] - ETA: 0s - loss: 1.5629 - acc: 0.4609
15744/15998 [============================>.] - ETA: 0s - loss: 1.5605 - acc: 0.4616
15872/15998 [============================>.] - ETA: 0s - loss: 1.5594 - acc: 0.4621
15998/15998 [==============================] - 9s 550us/step - loss: 1.5585 - acc: 0.4625 - val_loss: 1.4428 - val_acc: 0.5076
Epoch 3/10128/15998 [..............................] - ETA: 8s - loss: 1.4432 - acc: 0.5156256/15998 [..............................] - ETA: 8s - loss: 1.4685 - acc: 0.5000384/15998 [..............................] - ETA: 8s - loss: 1.4377 - acc: 0.5000512/15998 [..............................] - ETA: 8s - loss: 1.4322 - acc: 0.5098640/15998 [>.............................] - ETA: 8s - loss: 1.3727 - acc: 0.5250768/15998 [>.............................] - ETA: 8s - loss: 1.3286 - acc: 0.5365896/15998 [>.............................] - ETA: 7s - loss: 1.2856 - acc: 0.55471024/15998 [>.............................] - ETA: 7s - loss: 1.2669 - acc: 0.56251152/15998 [=>............................] - ETA: 7s - loss: 1.2457 - acc: 0.57031280/15998 [=>............................] - ETA: 7s - loss: 1.2563 - acc: 0.57031408/15998 [=>............................] - ETA: 7s - loss: 1.2710 - acc: 0.56611536/15998 [=>............................] - ETA: 7s - loss: 1.3025 - acc: 0.55531664/15998 [==>...........................] - ETA: 7s - loss: 1.3339 - acc: 0.54691792/15998 [==>...........................] - ETA: 7s - loss: 1.3356 - acc: 0.54691920/15998 [==>...........................] - ETA: 7s - loss: 1.3323 - acc: 0.54792048/15998 [==>...........................] - ETA: 7s - loss: 1.3172 - acc: 0.55222176/15998 [===>..........................] - ETA: 7s - loss: 1.3135 - acc: 0.55562304/15998 [===>..........................] - ETA: 6s - loss: 1.3068 - acc: 0.55732432/15998 [===>..........................] - ETA: 6s - loss: 1.3021 - acc: 0.55762560/15998 [===>..........................] - ETA: 6s - loss: 1.2993 - acc: 0.55822688/15998 [====>.........................] - ETA: 6s - loss: 1.3044 - acc: 0.55772816/15998 [====>.........................] - ETA: 6s - loss: 1.2994 - acc: 0.55972944/15998 [====>.........................] - ETA: 6s - loss: 1.2975 - acc: 0.56053072/15998 [====>.........................] - ETA: 6s - loss: 1.2902 - acc: 0.56253200/15998 [=====>........................] - ETA: 6s - loss: 1.2923 - acc: 0.56093328/15998 [=====>........................] - ETA: 6s - loss: 1.2915 - acc: 0.56043456/15998 [=====>........................] - ETA: 6s - loss: 1.2901 - acc: 0.56023584/15998 [=====>........................] - ETA: 6s - loss: 1.2861 - acc: 0.56003712/15998 [=====>........................] - ETA: 6s - loss: 1.2810 - acc: 0.56203840/15998 [======>.......................] - ETA: 6s - loss: 1.2803 - acc: 0.55913968/15998 [======>.......................] - ETA: 6s - loss: 1.2896 - acc: 0.55654096/15998 [======>.......................] - ETA: 6s - loss: 1.2841 - acc: 0.55544224/15998 [======>.......................] - ETA: 5s - loss: 1.2809 - acc: 0.55684352/15998 [=======>......................] - ETA: 5s - loss: 1.2827 - acc: 0.55584480/15998 [=======>......................] - ETA: 5s - loss: 1.2786 - acc: 0.55674608/15998 [=======>......................] - ETA: 5s - loss: 1.2762 - acc: 0.55884736/15998 [=======>......................] - ETA: 5s - loss: 1.2779 - acc: 0.55854864/15998 [========>.....................] - ETA: 5s - loss: 1.2722 - acc: 0.56044992/15998 [========>.....................] - ETA: 5s - loss: 1.2672 - acc: 0.56235120/15998 [========>.....................] - ETA: 5s - loss: 1.2678 - acc: 0.56095248/15998 [========>.....................] - ETA: 5s - loss: 1.2703 - acc: 0.55955376/15998 [=========>....................] - ETA: 5s - loss: 1.2716 - acc: 0.55805504/15998 [=========>....................] - ETA: 5s - loss: 1.2689 - acc: 0.55855632/15998 [=========>....................] - ETA: 5s - loss: 1.2664 - acc: 0.55955760/15998 [=========>....................] - ETA: 5s - loss: 1.2687 - acc: 0.55825888/15998 [==========>...................] - ETA: 5s - loss: 1.2655 - acc: 0.56056016/15998 [==========>...................] - ETA: 5s - loss: 1.2603 - acc: 0.56186144/15998 [==========>...................] - ETA: 4s - loss: 1.2579 - acc: 0.56306272/15998 [==========>...................] - ETA: 4s - loss: 1.2569 - acc: 0.56316400/15998 [===========>..................] - ETA: 4s - loss: 1.2559 - acc: 0.56336528/15998 [===========>..................] - ETA: 4s - loss: 1.2551 - acc: 0.56306656/15998 [===========>..................] - ETA: 4s - loss: 1.2607 - acc: 0.56136784/15998 [===========>..................] - ETA: 4s - loss: 1.2613 - acc: 0.56076912/15998 [===========>..................] - ETA: 4s - loss: 1.2573 - acc: 0.56257040/15998 [============>.................] - ETA: 4s - loss: 1.2559 - acc: 0.56227168/15998 [============>.................] - ETA: 4s - loss: 1.2567 - acc: 0.56227296/15998 [============>.................] - ETA: 4s - loss: 1.2538 - acc: 0.56367424/15998 [============>.................] - ETA: 4s - loss: 1.2539 - acc: 0.56367552/15998 [=============>................] - ETA: 4s - loss: 1.2536 - acc: 0.56297680/15998 [=============>................] - ETA: 4s - loss: 1.2598 - acc: 0.56207808/15998 [=============>................] - ETA: 4s - loss: 1.2594 - acc: 0.56257936/15998 [=============>................] - ETA: 4s - loss: 1.2566 - acc: 0.56348064/15998 [==============>...............] - ETA: 3s - loss: 1.2571 - acc: 0.56318192/15998 [==============>...............] - ETA: 3s - loss: 1.2553 - acc: 0.56298320/15998 [==============>...............] - ETA: 3s - loss: 1.2538 - acc: 0.56478448/15998 [==============>...............] - ETA: 3s - loss: 1.2520 - acc: 0.56598576/15998 [===============>..............] - ETA: 3s - loss: 1.2517 - acc: 0.56588704/15998 [===============>..............] - ETA: 3s - loss: 1.2513 - acc: 0.56578832/15998 [===============>..............] - ETA: 3s - loss: 1.2481 - acc: 0.56628960/15998 [===============>..............] - ETA: 3s - loss: 1.2413 - acc: 0.56869088/15998 [================>.............] - ETA: 3s - loss: 1.2376 - acc: 0.56999216/15998 [================>.............] - ETA: 3s - loss: 1.2363 - acc: 0.57049344/15998 [================>.............] - ETA: 3s - loss: 1.2351 - acc: 0.57049472/15998 [================>.............] - ETA: 3s - loss: 1.2330 - acc: 0.57119600/15998 [=================>............] - ETA: 3s - loss: 1.2322 - acc: 0.57169728/15998 [=================>............] - ETA: 3s - loss: 1.2344 - acc: 0.57089856/15998 [=================>............] - ETA: 3s - loss: 1.2353 - acc: 0.57059984/15998 [=================>............] - ETA: 3s - loss: 1.2335 - acc: 0.5712
10112/15998 [=================>............] - ETA: 2s - loss: 1.2317 - acc: 0.5718
10240/15998 [==================>...........] - ETA: 2s - loss: 1.2313 - acc: 0.5714
10368/15998 [==================>...........] - ETA: 2s - loss: 1.2310 - acc: 0.5718
10496/15998 [==================>...........] - ETA: 2s - loss: 1.2305 - acc: 0.5716
10624/15998 [==================>...........] - ETA: 2s - loss: 1.2300 - acc: 0.5718
10752/15998 [===================>..........] - ETA: 2s - loss: 1.2277 - acc: 0.5725
10880/15998 [===================>..........] - ETA: 2s - loss: 1.2266 - acc: 0.5725
11008/15998 [===================>..........] - ETA: 2s - loss: 1.2253 - acc: 0.5728
11136/15998 [===================>..........] - ETA: 2s - loss: 1.2244 - acc: 0.5732
11264/15998 [====================>.........] - ETA: 2s - loss: 1.2238 - acc: 0.5734
11392/15998 [====================>.........] - ETA: 2s - loss: 1.2215 - acc: 0.5741
11520/15998 [====================>.........] - ETA: 2s - loss: 1.2224 - acc: 0.5741
11648/15998 [====================>.........] - ETA: 2s - loss: 1.2233 - acc: 0.5737
11776/15998 [=====================>........] - ETA: 2s - loss: 1.2228 - acc: 0.5736
11904/15998 [=====================>........] - ETA: 2s - loss: 1.2217 - acc: 0.5742
12032/15998 [=====================>........] - ETA: 1s - loss: 1.2207 - acc: 0.5736
12160/15998 [=====================>........] - ETA: 1s - loss: 1.2188 - acc: 0.5747
12288/15998 [======================>.......] - ETA: 1s - loss: 1.2186 - acc: 0.5745
12416/15998 [======================>.......] - ETA: 1s - loss: 1.2204 - acc: 0.5735
12544/15998 [======================>.......] - ETA: 1s - loss: 1.2204 - acc: 0.5740
12672/15998 [======================>.......] - ETA: 1s - loss: 1.2195 - acc: 0.5748
12800/15998 [=======================>......] - ETA: 1s - loss: 1.2190 - acc: 0.5755
12928/15998 [=======================>......] - ETA: 1s - loss: 1.2181 - acc: 0.5756
13056/15998 [=======================>......] - ETA: 1s - loss: 1.2151 - acc: 0.5765
13184/15998 [=======================>......] - ETA: 1s - loss: 1.2144 - acc: 0.5774
13312/15998 [=======================>......] - ETA: 1s - loss: 1.2146 - acc: 0.5775
13440/15998 [========================>.....] - ETA: 1s - loss: 1.2133 - acc: 0.5782
13568/15998 [========================>.....] - ETA: 1s - loss: 1.2134 - acc: 0.5777
13696/15998 [========================>.....] - ETA: 1s - loss: 1.2145 - acc: 0.5768
13824/15998 [========================>.....] - ETA: 1s - loss: 1.2150 - acc: 0.5766
13952/15998 [=========================>....] - ETA: 1s - loss: 1.2144 - acc: 0.5768
14080/15998 [=========================>....] - ETA: 0s - loss: 1.2153 - acc: 0.5764
14208/15998 [=========================>....] - ETA: 0s - loss: 1.2151 - acc: 0.5765
14336/15998 [=========================>....] - ETA: 0s - loss: 1.2134 - acc: 0.5771
14464/15998 [==========================>...] - ETA: 0s - loss: 1.2116 - acc: 0.5779
14592/15998 [==========================>...] - ETA: 0s - loss: 1.2111 - acc: 0.5783
14720/15998 [==========================>...] - ETA: 0s - loss: 1.2100 - acc: 0.5785
14848/15998 [==========================>...] - ETA: 0s - loss: 1.2079 - acc: 0.5795
14976/15998 [===========================>..] - ETA: 0s - loss: 1.2060 - acc: 0.5802
15104/15998 [===========================>..] - ETA: 0s - loss: 1.2066 - acc: 0.5802
15232/15998 [===========================>..] - ETA: 0s - loss: 1.2048 - acc: 0.5809
15360/15998 [===========================>..] - ETA: 0s - loss: 1.2036 - acc: 0.5816
15488/15998 [============================>.] - ETA: 0s - loss: 1.2037 - acc: 0.5817
15616/15998 [============================>.] - ETA: 0s - loss: 1.2027 - acc: 0.5820
15744/15998 [============================>.] - ETA: 0s - loss: 1.2022 - acc: 0.5820
15872/15998 [============================>.] - ETA: 0s - loss: 1.2013 - acc: 0.5823
15998/15998 [==============================] - 9s 548us/step - loss: 1.2004 - acc: 0.5824 - val_loss: 1.0866 - val_acc: 0.6412
Epoch 4/10128/15998 [..............................] - ETA: 7s - loss: 1.0405 - acc: 0.7188256/15998 [..............................] - ETA: 7s - loss: 0.9775 - acc: 0.7109384/15998 [..............................] - ETA: 7s - loss: 1.0334 - acc: 0.6849512/15998 [..............................] - ETA: 7s - loss: 1.0898 - acc: 0.6621640/15998 [>.............................] - ETA: 7s - loss: 1.0770 - acc: 0.6625768/15998 [>.............................] - ETA: 7s - loss: 1.0884 - acc: 0.6510896/15998 [>.............................] - ETA: 7s - loss: 1.0646 - acc: 0.65181024/15998 [>.............................] - ETA: 7s - loss: 1.0433 - acc: 0.65921152/15998 [=>............................] - ETA: 7s - loss: 1.0249 - acc: 0.66671280/15998 [=>............................] - ETA: 7s - loss: 1.0287 - acc: 0.66721408/15998 [=>............................] - ETA: 7s - loss: 1.0226 - acc: 0.67191536/15998 [=>............................] - ETA: 7s - loss: 1.0540 - acc: 0.66081664/15998 [==>...........................] - ETA: 7s - loss: 1.0471 - acc: 0.66351792/15998 [==>...........................] - ETA: 7s - loss: 1.0432 - acc: 0.66351920/15998 [==>...........................] - ETA: 6s - loss: 1.0381 - acc: 0.66352048/15998 [==>...........................] - ETA: 6s - loss: 1.0403 - acc: 0.66112176/15998 [===>..........................] - ETA: 6s - loss: 1.0271 - acc: 0.66592304/15998 [===>..........................] - ETA: 6s - loss: 1.0173 - acc: 0.66932432/15998 [===>..........................] - ETA: 6s - loss: 1.0117 - acc: 0.66942560/15998 [===>..........................] - ETA: 6s - loss: 1.0126 - acc: 0.66912688/15998 [====>.........................] - ETA: 6s - loss: 1.0124 - acc: 0.66962816/15998 [====>.........................] - ETA: 6s - loss: 1.0105 - acc: 0.66902944/15998 [====>.........................] - ETA: 6s - loss: 1.0110 - acc: 0.66713072/15998 [====>.........................] - ETA: 6s - loss: 1.0188 - acc: 0.66313200/15998 [=====>........................] - ETA: 6s - loss: 1.0197 - acc: 0.66223328/15998 [=====>........................] - ETA: 6s - loss: 1.0197 - acc: 0.66203456/15998 [=====>........................] - ETA: 6s - loss: 1.0158 - acc: 0.66203584/15998 [=====>........................] - ETA: 6s - loss: 1.0286 - acc: 0.65883712/15998 [=====>........................] - ETA: 6s - loss: 1.0403 - acc: 0.65573840/15998 [======>.......................] - ETA: 6s - loss: 1.0338 - acc: 0.65653968/15998 [======>.......................] - ETA: 5s - loss: 1.0292 - acc: 0.65734096/15998 [======>.......................] - ETA: 5s - loss: 1.0272 - acc: 0.65704224/15998 [======>.......................] - ETA: 5s - loss: 1.0292 - acc: 0.65554352/15998 [=======>......................] - ETA: 5s - loss: 1.0247 - acc: 0.65764480/15998 [=======>......................] - ETA: 5s - loss: 1.0196 - acc: 0.65854608/15998 [=======>......................] - ETA: 5s - loss: 1.0180 - acc: 0.65894736/15998 [=======>......................] - ETA: 5s - loss: 1.0201 - acc: 0.65824864/15998 [========>.....................] - ETA: 5s - loss: 1.0146 - acc: 0.66024992/15998 [========>.....................] - ETA: 5s - loss: 1.0179 - acc: 0.65755120/15998 [========>.....................] - ETA: 5s - loss: 1.0240 - acc: 0.65475248/15998 [========>.....................] - ETA: 5s - loss: 1.0259 - acc: 0.65345376/15998 [=========>....................] - ETA: 5s - loss: 1.0242 - acc: 0.65315504/15998 [=========>....................] - ETA: 5s - loss: 1.0220 - acc: 0.65375632/15998 [=========>....................] - ETA: 5s - loss: 1.0269 - acc: 0.65235760/15998 [=========>....................] - ETA: 5s - loss: 1.0262 - acc: 0.65265888/15998 [==========>...................] - ETA: 5s - loss: 1.0268 - acc: 0.65256016/15998 [==========>...................] - ETA: 4s - loss: 1.0279 - acc: 0.65246144/15998 [==========>...................] - ETA: 4s - loss: 1.0274 - acc: 0.65226272/15998 [==========>...................] - ETA: 4s - loss: 1.0254 - acc: 0.65356400/15998 [===========>..................] - ETA: 4s - loss: 1.0221 - acc: 0.65446528/15998 [===========>..................] - ETA: 4s - loss: 1.0189 - acc: 0.65556656/15998 [===========>..................] - ETA: 4s - loss: 1.0158 - acc: 0.65706784/15998 [===========>..................] - ETA: 4s - loss: 1.0122 - acc: 0.65836912/15998 [===========>..................] - ETA: 4s - loss: 1.0138 - acc: 0.65737040/15998 [============>.................] - ETA: 4s - loss: 1.0176 - acc: 0.65537168/15998 [============>.................] - ETA: 4s - loss: 1.0188 - acc: 0.65497296/15998 [============>.................] - ETA: 4s - loss: 1.0198 - acc: 0.65417424/15998 [============>.................] - ETA: 4s - loss: 1.0218 - acc: 0.65267552/15998 [=============>................] - ETA: 4s - loss: 1.0218 - acc: 0.65287680/15998 [=============>................] - ETA: 4s - loss: 1.0196 - acc: 0.65347808/15998 [=============>................] - ETA: 4s - loss: 1.0186 - acc: 0.65387936/15998 [=============>................] - ETA: 4s - loss: 1.0179 - acc: 0.65418064/15998 [==============>...............] - ETA: 3s - loss: 1.0166 - acc: 0.65468192/15998 [==============>...............] - ETA: 3s - loss: 1.0176 - acc: 0.65368320/15998 [==============>...............] - ETA: 3s - loss: 1.0193 - acc: 0.65348448/15998 [==============>...............] - ETA: 3s - loss: 1.0179 - acc: 0.65448576/15998 [===============>..............] - ETA: 3s - loss: 1.0158 - acc: 0.65478704/15998 [===============>..............] - ETA: 3s - loss: 1.0147 - acc: 0.65578832/15998 [===============>..............] - ETA: 3s - loss: 1.0161 - acc: 0.65488960/15998 [===============>..............] - ETA: 3s - loss: 1.0150 - acc: 0.65559088/15998 [================>.............] - ETA: 3s - loss: 1.0153 - acc: 0.65499216/15998 [================>.............] - ETA: 3s - loss: 1.0169 - acc: 0.65409344/15998 [================>.............] - ETA: 3s - loss: 1.0138 - acc: 0.65499472/15998 [================>.............] - ETA: 3s - loss: 1.0147 - acc: 0.65499600/15998 [=================>............] - ETA: 3s - loss: 1.0157 - acc: 0.65419728/15998 [=================>............] - ETA: 3s - loss: 1.0141 - acc: 0.65539856/15998 [=================>............] - ETA: 3s - loss: 1.0122 - acc: 0.65599984/15998 [=================>............] - ETA: 3s - loss: 1.0128 - acc: 0.6555
10112/15998 [=================>............] - ETA: 2s - loss: 1.0107 - acc: 0.6567
10240/15998 [==================>...........] - ETA: 2s - loss: 1.0119 - acc: 0.6562
10368/15998 [==================>...........] - ETA: 2s - loss: 1.0123 - acc: 0.6558
10496/15998 [==================>...........] - ETA: 2s - loss: 1.0115 - acc: 0.6564
10624/15998 [==================>...........] - ETA: 2s - loss: 1.0102 - acc: 0.6567
10752/15998 [===================>..........] - ETA: 2s - loss: 1.0073 - acc: 0.6573
10880/15998 [===================>..........] - ETA: 2s - loss: 1.0051 - acc: 0.6574
11008/15998 [===================>..........] - ETA: 2s - loss: 1.0049 - acc: 0.6572
11136/15998 [===================>..........] - ETA: 2s - loss: 1.0050 - acc: 0.6567
11264/15998 [====================>.........] - ETA: 2s - loss: 1.0025 - acc: 0.6578
11392/15998 [====================>.........] - ETA: 2s - loss: 1.0019 - acc: 0.6579
11520/15998 [====================>.........] - ETA: 2s - loss: 1.0001 - acc: 0.6584
11648/15998 [====================>.........] - ETA: 2s - loss: 0.9997 - acc: 0.6586
11776/15998 [=====================>........] - ETA: 2s - loss: 1.0001 - acc: 0.6581
11904/15998 [=====================>........] - ETA: 2s - loss: 0.9994 - acc: 0.6584
12032/15998 [=====================>........] - ETA: 1s - loss: 0.9993 - acc: 0.6586
12160/15998 [=====================>........] - ETA: 1s - loss: 0.9981 - acc: 0.6584
12288/15998 [======================>.......] - ETA: 1s - loss: 0.9957 - acc: 0.6590
12416/15998 [======================>.......] - ETA: 1s - loss: 0.9954 - acc: 0.6592
12544/15998 [======================>.......] - ETA: 1s - loss: 0.9947 - acc: 0.6591
12672/15998 [======================>.......] - ETA: 1s - loss: 0.9941 - acc: 0.6593
12800/15998 [=======================>......] - ETA: 1s - loss: 0.9922 - acc: 0.6595
12928/15998 [=======================>......] - ETA: 1s - loss: 0.9924 - acc: 0.6594
13056/15998 [=======================>......] - ETA: 1s - loss: 0.9921 - acc: 0.6592
13184/15998 [=======================>......] - ETA: 1s - loss: 0.9920 - acc: 0.6594
13312/15998 [=======================>......] - ETA: 1s - loss: 0.9936 - acc: 0.6593
13440/15998 [========================>.....] - ETA: 1s - loss: 0.9940 - acc: 0.6592
13568/15998 [========================>.....] - ETA: 1s - loss: 0.9928 - acc: 0.6595
13696/15998 [========================>.....] - ETA: 1s - loss: 0.9922 - acc: 0.6597
13824/15998 [========================>.....] - ETA: 1s - loss: 0.9917 - acc: 0.6596
13952/15998 [=========================>....] - ETA: 1s - loss: 0.9923 - acc: 0.6593
14080/15998 [=========================>....] - ETA: 0s - loss: 0.9918 - acc: 0.6593
14208/15998 [=========================>....] - ETA: 0s - loss: 0.9930 - acc: 0.6593
14336/15998 [=========================>....] - ETA: 0s - loss: 0.9913 - acc: 0.6598
14464/15998 [==========================>...] - ETA: 0s - loss: 0.9899 - acc: 0.6604
14592/15998 [==========================>...] - ETA: 0s - loss: 0.9883 - acc: 0.6608
14720/15998 [==========================>...] - ETA: 0s - loss: 0.9879 - acc: 0.6607
14848/15998 [==========================>...] - ETA: 0s - loss: 0.9888 - acc: 0.6606
14976/15998 [===========================>..] - ETA: 0s - loss: 0.9896 - acc: 0.6605
15104/15998 [===========================>..] - ETA: 0s - loss: 0.9903 - acc: 0.6605
15232/15998 [===========================>..] - ETA: 0s - loss: 0.9891 - acc: 0.6608
15360/15998 [===========================>..] - ETA: 0s - loss: 0.9882 - acc: 0.6609
15488/15998 [============================>.] - ETA: 0s - loss: 0.9869 - acc: 0.6614
15616/15998 [============================>.] - ETA: 0s - loss: 0.9862 - acc: 0.6615
15744/15998 [============================>.] - ETA: 0s - loss: 0.9857 - acc: 0.6615
15872/15998 [============================>.] - ETA: 0s - loss: 0.9856 - acc: 0.6619
15998/15998 [==============================] - 9s 550us/step - loss: 0.9845 - acc: 0.6625 - val_loss: 1.0490 - val_acc: 0.6517
Epoch 5/10128/15998 [..............................] - ETA: 7s - loss: 0.7645 - acc: 0.7188256/15998 [..............................] - ETA: 7s - loss: 0.7739 - acc: 0.7305384/15998 [..............................] - ETA: 7s - loss: 0.7723 - acc: 0.7266512/15998 [..............................] - ETA: 7s - loss: 0.7363 - acc: 0.7539640/15998 [>.............................] - ETA: 7s - loss: 0.7504 - acc: 0.7422768/15998 [>.............................] - ETA: 7s - loss: 0.8080 - acc: 0.7253896/15998 [>.............................] - ETA: 7s - loss: 0.8588 - acc: 0.71091024/15998 [>.............................] - ETA: 7s - loss: 0.8869 - acc: 0.69731152/15998 [=>............................] - ETA: 7s - loss: 0.8803 - acc: 0.70141280/15998 [=>............................] - ETA: 7s - loss: 0.8705 - acc: 0.70631408/15998 [=>............................] - ETA: 7s - loss: 0.8773 - acc: 0.70531536/15998 [=>............................] - ETA: 7s - loss: 0.8698 - acc: 0.70831664/15998 [==>...........................] - ETA: 7s - loss: 0.8626 - acc: 0.71151792/15998 [==>...........................] - ETA: 7s - loss: 0.8712 - acc: 0.70651920/15998 [==>...........................] - ETA: 6s - loss: 0.8710 - acc: 0.70472048/15998 [==>...........................] - ETA: 6s - loss: 0.8658 - acc: 0.70562176/15998 [===>..........................] - ETA: 6s - loss: 0.8636 - acc: 0.70402304/15998 [===>..........................] - ETA: 6s - loss: 0.8705 - acc: 0.70312432/15998 [===>..........................] - ETA: 6s - loss: 0.8711 - acc: 0.70442560/15998 [===>..........................] - ETA: 6s - loss: 0.8724 - acc: 0.70432688/15998 [====>.........................] - ETA: 6s - loss: 0.8780 - acc: 0.70012816/15998 [====>.........................] - ETA: 6s - loss: 0.8901 - acc: 0.69672944/15998 [====>.........................] - ETA: 6s - loss: 0.8918 - acc: 0.69633072/15998 [====>.........................] - ETA: 6s - loss: 0.8925 - acc: 0.69733200/15998 [=====>........................] - ETA: 6s - loss: 0.8912 - acc: 0.69943328/15998 [=====>........................] - ETA: 6s - loss: 0.8933 - acc: 0.69833456/15998 [=====>........................] - ETA: 6s - loss: 0.8925 - acc: 0.69943584/15998 [=====>........................] - ETA: 6s - loss: 0.8841 - acc: 0.70263712/15998 [=====>........................] - ETA: 6s - loss: 0.8784 - acc: 0.70423840/15998 [======>.......................] - ETA: 6s - loss: 0.8753 - acc: 0.70493968/15998 [======>.......................] - ETA: 5s - loss: 0.8788 - acc: 0.70344096/15998 [======>.......................] - ETA: 5s - loss: 0.8754 - acc: 0.70414224/15998 [======>.......................] - ETA: 5s - loss: 0.8750 - acc: 0.70384352/15998 [=======>......................] - ETA: 5s - loss: 0.8768 - acc: 0.70404480/15998 [=======>......................] - ETA: 5s - loss: 0.8778 - acc: 0.70454608/15998 [=======>......................] - ETA: 5s - loss: 0.8783 - acc: 0.70334736/15998 [=======>......................] - ETA: 5s - loss: 0.8854 - acc: 0.70104864/15998 [========>.....................] - ETA: 5s - loss: 0.8841 - acc: 0.70154992/15998 [========>.....................] - ETA: 5s - loss: 0.8796 - acc: 0.70295120/15998 [========>.....................] - ETA: 5s - loss: 0.8787 - acc: 0.70335248/15998 [========>.....................] - ETA: 5s - loss: 0.8788 - acc: 0.70375376/15998 [=========>....................] - ETA: 5s - loss: 0.8777 - acc: 0.70335504/15998 [=========>....................] - ETA: 5s - loss: 0.8825 - acc: 0.70245632/15998 [=========>....................] - ETA: 5s - loss: 0.8812 - acc: 0.70245760/15998 [=========>....................] - ETA: 5s - loss: 0.8795 - acc: 0.70265888/15998 [==========>...................] - ETA: 5s - loss: 0.8732 - acc: 0.70416016/15998 [==========>...................] - ETA: 4s - loss: 0.8690 - acc: 0.70616144/15998 [==========>...................] - ETA: 4s - loss: 0.8689 - acc: 0.70646272/15998 [==========>...................] - ETA: 4s - loss: 0.8654 - acc: 0.70776400/15998 [===========>..................] - ETA: 4s - loss: 0.8662 - acc: 0.70726528/15998 [===========>..................] - ETA: 4s - loss: 0.8639 - acc: 0.70826656/15998 [===========>..................] - ETA: 4s - loss: 0.8602 - acc: 0.70876784/15998 [===========>..................] - ETA: 4s - loss: 0.8582 - acc: 0.70936912/15998 [===========>..................] - ETA: 4s - loss: 0.8547 - acc: 0.70957040/15998 [============>.................] - ETA: 4s - loss: 0.8531 - acc: 0.71027168/15998 [============>.................] - ETA: 4s - loss: 0.8557 - acc: 0.70987296/15998 [============>.................] - ETA: 4s - loss: 0.8565 - acc: 0.70947424/15998 [============>.................] - ETA: 4s - loss: 0.8549 - acc: 0.71017552/15998 [=============>................] - ETA: 4s - loss: 0.8561 - acc: 0.70957680/15998 [=============>................] - ETA: 4s - loss: 0.8542 - acc: 0.71037808/15998 [=============>................] - ETA: 4s - loss: 0.8539 - acc: 0.71047936/15998 [=============>................] - ETA: 4s - loss: 0.8536 - acc: 0.70998064/15998 [==============>...............] - ETA: 3s - loss: 0.8564 - acc: 0.70888192/15998 [==============>...............] - ETA: 3s - loss: 0.8539 - acc: 0.70968320/15998 [==============>...............] - ETA: 3s - loss: 0.8561 - acc: 0.70838448/15998 [==============>...............] - ETA: 3s - loss: 0.8568 - acc: 0.70798576/15998 [===============>..............] - ETA: 3s - loss: 0.8551 - acc: 0.70878704/15998 [===============>..............] - ETA: 3s - loss: 0.8526 - acc: 0.70938832/15998 [===============>..............] - ETA: 3s - loss: 0.8534 - acc: 0.70918960/15998 [===============>..............] - ETA: 3s - loss: 0.8503 - acc: 0.71009088/15998 [================>.............] - ETA: 3s - loss: 0.8482 - acc: 0.71109216/15998 [================>.............] - ETA: 3s - loss: 0.8466 - acc: 0.71159344/15998 [================>.............] - ETA: 3s - loss: 0.8486 - acc: 0.71089472/15998 [================>.............] - ETA: 3s - loss: 0.8481 - acc: 0.71149600/15998 [=================>............] - ETA: 3s - loss: 0.8494 - acc: 0.71119728/15998 [=================>............] - ETA: 3s - loss: 0.8463 - acc: 0.71219856/15998 [=================>............] - ETA: 3s - loss: 0.8460 - acc: 0.71239984/15998 [=================>............] - ETA: 2s - loss: 0.8426 - acc: 0.7134
10112/15998 [=================>............] - ETA: 2s - loss: 0.8407 - acc: 0.7138
10240/15998 [==================>...........] - ETA: 2s - loss: 0.8396 - acc: 0.7137
10368/15998 [==================>...........] - ETA: 2s - loss: 0.8408 - acc: 0.7130
10496/15998 [==================>...........] - ETA: 2s - loss: 0.8428 - acc: 0.7120
10624/15998 [==================>...........] - ETA: 2s - loss: 0.8426 - acc: 0.7118
10752/15998 [===================>..........] - ETA: 2s - loss: 0.8412 - acc: 0.7123
10880/15998 [===================>..........] - ETA: 2s - loss: 0.8426 - acc: 0.7123
11008/15998 [===================>..........] - ETA: 2s - loss: 0.8415 - acc: 0.7124
11136/15998 [===================>..........] - ETA: 2s - loss: 0.8423 - acc: 0.7129
11264/15998 [====================>.........] - ETA: 2s - loss: 0.8417 - acc: 0.7132
11392/15998 [====================>.........] - ETA: 2s - loss: 0.8410 - acc: 0.7131
11520/15998 [====================>.........] - ETA: 2s - loss: 0.8417 - acc: 0.7133
11648/15998 [====================>.........] - ETA: 2s - loss: 0.8412 - acc: 0.7138
11776/15998 [=====================>........] - ETA: 2s - loss: 0.8416 - acc: 0.7132
11904/15998 [=====================>........] - ETA: 2s - loss: 0.8419 - acc: 0.7135
12032/15998 [=====================>........] - ETA: 1s - loss: 0.8415 - acc: 0.7135
12160/15998 [=====================>........] - ETA: 1s - loss: 0.8412 - acc: 0.7133
12288/15998 [======================>.......] - ETA: 1s - loss: 0.8397 - acc: 0.7137
12416/15998 [======================>.......] - ETA: 1s - loss: 0.8397 - acc: 0.7138
12544/15998 [======================>.......] - ETA: 1s - loss: 0.8381 - acc: 0.7144
12672/15998 [======================>.......] - ETA: 1s - loss: 0.8368 - acc: 0.7146
12800/15998 [=======================>......] - ETA: 1s - loss: 0.8375 - acc: 0.7144
12928/15998 [=======================>......] - ETA: 1s - loss: 0.8367 - acc: 0.7145
13056/15998 [=======================>......] - ETA: 1s - loss: 0.8363 - acc: 0.7147
13184/15998 [=======================>......] - ETA: 1s - loss: 0.8342 - acc: 0.7153
13312/15998 [=======================>......] - ETA: 1s - loss: 0.8362 - acc: 0.7143
13440/15998 [========================>.....] - ETA: 1s - loss: 0.8350 - acc: 0.7147
13568/15998 [========================>.....] - ETA: 1s - loss: 0.8354 - acc: 0.7148
13696/15998 [========================>.....] - ETA: 1s - loss: 0.8353 - acc: 0.7146
13824/15998 [========================>.....] - ETA: 1s - loss: 0.8368 - acc: 0.7143
13952/15998 [=========================>....] - ETA: 1s - loss: 0.8358 - acc: 0.7147
14080/15998 [=========================>....] - ETA: 0s - loss: 0.8373 - acc: 0.7142
14208/15998 [=========================>....] - ETA: 0s - loss: 0.8385 - acc: 0.7139
14336/15998 [=========================>....] - ETA: 0s - loss: 0.8380 - acc: 0.7139
14464/15998 [==========================>...] - ETA: 0s - loss: 0.8384 - acc: 0.7143
14592/15998 [==========================>...] - ETA: 0s - loss: 0.8390 - acc: 0.7142
14720/15998 [==========================>...] - ETA: 0s - loss: 0.8394 - acc: 0.7140
14848/15998 [==========================>...] - ETA: 0s - loss: 0.8381 - acc: 0.7144
14976/15998 [===========================>..] - ETA: 0s - loss: 0.8384 - acc: 0.7141
15104/15998 [===========================>..] - ETA: 0s - loss: 0.8424 - acc: 0.7133
15232/15998 [===========================>..] - ETA: 0s - loss: 0.8420 - acc: 0.7134
15360/15998 [===========================>..] - ETA: 0s - loss: 0.8408 - acc: 0.7143
15488/15998 [============================>.] - ETA: 0s - loss: 0.8411 - acc: 0.7144
15616/15998 [============================>.] - ETA: 0s - loss: 0.8401 - acc: 0.7148
15744/15998 [============================>.] - ETA: 0s - loss: 0.8389 - acc: 0.7153
15872/15998 [============================>.] - ETA: 0s - loss: 0.8385 - acc: 0.7157
15998/15998 [==============================] - 9s 549us/step - loss: 0.8377 - acc: 0.7157 - val_loss: 1.1228 - val_acc: 0.6347
Epoch 6/10128/15998 [..............................] - ETA: 8s - loss: 0.8649 - acc: 0.7344256/15998 [..............................] - ETA: 8s - loss: 0.7988 - acc: 0.7461384/15998 [..............................] - ETA: 8s - loss: 0.7534 - acc: 0.7630512/15998 [..............................] - ETA: 7s - loss: 0.7067 - acc: 0.7773640/15998 [>.............................] - ETA: 7s - loss: 0.7061 - acc: 0.7750768/15998 [>.............................] - ETA: 7s - loss: 0.7240 - acc: 0.7695896/15998 [>.............................] - ETA: 7s - loss: 0.7294 - acc: 0.77011024/15998 [>.............................] - ETA: 7s - loss: 0.6924 - acc: 0.78121152/15998 [=>............................] - ETA: 7s - loss: 0.6977 - acc: 0.78041280/15998 [=>............................] - ETA: 7s - loss: 0.6832 - acc: 0.78201408/15998 [=>............................] - ETA: 7s - loss: 0.6789 - acc: 0.78201536/15998 [=>............................] - ETA: 7s - loss: 0.6833 - acc: 0.78121664/15998 [==>...........................] - ETA: 7s - loss: 0.6817 - acc: 0.78061792/15998 [==>...........................] - ETA: 7s - loss: 0.6799 - acc: 0.78181920/15998 [==>...........................] - ETA: 7s - loss: 0.6860 - acc: 0.77762048/15998 [==>...........................] - ETA: 7s - loss: 0.6983 - acc: 0.77292176/15998 [===>..........................] - ETA: 7s - loss: 0.7067 - acc: 0.76842304/15998 [===>..........................] - ETA: 6s - loss: 0.7277 - acc: 0.76262432/15998 [===>..........................] - ETA: 6s - loss: 0.7321 - acc: 0.76272560/15998 [===>..........................] - ETA: 6s - loss: 0.7368 - acc: 0.75982688/15998 [====>.........................] - ETA: 6s - loss: 0.7384 - acc: 0.76042816/15998 [====>.........................] - ETA: 6s - loss: 0.7343 - acc: 0.76142944/15998 [====>.........................] - ETA: 6s - loss: 0.7268 - acc: 0.76363072/15998 [====>.........................] - ETA: 6s - loss: 0.7331 - acc: 0.75983200/15998 [=====>........................] - ETA: 6s - loss: 0.7254 - acc: 0.76223328/15998 [=====>........................] - ETA: 6s - loss: 0.7255 - acc: 0.76083456/15998 [=====>........................] - ETA: 6s - loss: 0.7199 - acc: 0.76163584/15998 [=====>........................] - ETA: 6s - loss: 0.7156 - acc: 0.76203712/15998 [=====>........................] - ETA: 6s - loss: 0.7144 - acc: 0.76163840/15998 [======>.......................] - ETA: 6s - loss: 0.7194 - acc: 0.75993968/15998 [======>.......................] - ETA: 6s - loss: 0.7231 - acc: 0.75964096/15998 [======>.......................] - ETA: 6s - loss: 0.7239 - acc: 0.75884224/15998 [======>.......................] - ETA: 5s - loss: 0.7243 - acc: 0.75804352/15998 [=======>......................] - ETA: 5s - loss: 0.7266 - acc: 0.75804480/15998 [=======>......................] - ETA: 5s - loss: 0.7300 - acc: 0.75764608/15998 [=======>......................] - ETA: 5s - loss: 0.7355 - acc: 0.75544736/15998 [=======>......................] - ETA: 5s - loss: 0.7378 - acc: 0.75424864/15998 [========>.....................] - ETA: 5s - loss: 0.7415 - acc: 0.75414992/15998 [========>.....................] - ETA: 5s - loss: 0.7428 - acc: 0.75505120/15998 [========>.....................] - ETA: 5s - loss: 0.7410 - acc: 0.75395248/15998 [========>.....................] - ETA: 5s - loss: 0.7426 - acc: 0.75425376/15998 [=========>....................] - ETA: 5s - loss: 0.7376 - acc: 0.75605504/15998 [=========>....................] - ETA: 5s - loss: 0.7349 - acc: 0.75695632/15998 [=========>....................] - ETA: 5s - loss: 0.7319 - acc: 0.75755760/15998 [=========>....................] - ETA: 5s - loss: 0.7275 - acc: 0.75855888/15998 [==========>...................] - ETA: 5s - loss: 0.7249 - acc: 0.75956016/15998 [==========>...................] - ETA: 5s - loss: 0.7228 - acc: 0.76006144/15998 [==========>...................] - ETA: 4s - loss: 0.7193 - acc: 0.76066272/15998 [==========>...................] - ETA: 4s - loss: 0.7190 - acc: 0.76086400/15998 [===========>..................] - ETA: 4s - loss: 0.7154 - acc: 0.76166528/15998 [===========>..................] - ETA: 4s - loss: 0.7114 - acc: 0.76336656/15998 [===========>..................] - ETA: 4s - loss: 0.7165 - acc: 0.76266784/15998 [===========>..................] - ETA: 4s - loss: 0.7155 - acc: 0.76246912/15998 [===========>..................] - ETA: 4s - loss: 0.7121 - acc: 0.76327040/15998 [============>.................] - ETA: 4s - loss: 0.7105 - acc: 0.76387168/15998 [============>.................] - ETA: 4s - loss: 0.7084 - acc: 0.76517296/15998 [============>.................] - ETA: 4s - loss: 0.7064 - acc: 0.76587424/15998 [============>.................] - ETA: 4s - loss: 0.7028 - acc: 0.76757552/15998 [=============>................] - ETA: 4s - loss: 0.7029 - acc: 0.76687680/15998 [=============>................] - ETA: 4s - loss: 0.7029 - acc: 0.76647808/15998 [=============>................] - ETA: 4s - loss: 0.7049 - acc: 0.76567936/15998 [=============>................] - ETA: 4s - loss: 0.7050 - acc: 0.76598064/15998 [==============>...............] - ETA: 4s - loss: 0.7043 - acc: 0.76648192/15998 [==============>...............] - ETA: 3s - loss: 0.7033 - acc: 0.76688320/15998 [==============>...............] - ETA: 3s - loss: 0.7028 - acc: 0.76738448/15998 [==============>...............] - ETA: 3s - loss: 0.7042 - acc: 0.76658576/15998 [===============>..............] - ETA: 3s - loss: 0.7048 - acc: 0.76618704/15998 [===============>..............] - ETA: 3s - loss: 0.7051 - acc: 0.76598832/15998 [===============>..............] - ETA: 3s - loss: 0.7067 - acc: 0.76548960/15998 [===============>..............] - ETA: 3s - loss: 0.7054 - acc: 0.76609088/15998 [================>.............] - ETA: 3s - loss: 0.7046 - acc: 0.76579216/15998 [================>.............] - ETA: 3s - loss: 0.7057 - acc: 0.76559344/15998 [================>.............] - ETA: 3s - loss: 0.7069 - acc: 0.76539472/15998 [================>.............] - ETA: 3s - loss: 0.7096 - acc: 0.76519600/15998 [=================>............] - ETA: 3s - loss: 0.7111 - acc: 0.76389728/15998 [=================>............] - ETA: 3s - loss: 0.7142 - acc: 0.76289856/15998 [=================>............] - ETA: 3s - loss: 0.7142 - acc: 0.76239984/15998 [=================>............] - ETA: 3s - loss: 0.7145 - acc: 0.7622
10112/15998 [=================>............] - ETA: 3s - loss: 0.7142 - acc: 0.7619
10240/15998 [==================>...........] - ETA: 2s - loss: 0.7137 - acc: 0.7618
10368/15998 [==================>...........] - ETA: 2s - loss: 0.7110 - acc: 0.7624
10496/15998 [==================>...........] - ETA: 2s - loss: 0.7081 - acc: 0.7633
10624/15998 [==================>...........] - ETA: 2s - loss: 0.7096 - acc: 0.7624
10752/15998 [===================>..........] - ETA: 2s - loss: 0.7076 - acc: 0.7627
10880/15998 [===================>..........] - ETA: 2s - loss: 0.7071 - acc: 0.7630
11008/15998 [===================>..........] - ETA: 2s - loss: 0.7059 - acc: 0.7630
11136/15998 [===================>..........] - ETA: 2s - loss: 0.7071 - acc: 0.7628
11264/15998 [====================>.........] - ETA: 2s - loss: 0.7044 - acc: 0.7638
11392/15998 [====================>.........] - ETA: 2s - loss: 0.7039 - acc: 0.7636
11520/15998 [====================>.........] - ETA: 2s - loss: 0.7044 - acc: 0.7635
11648/15998 [====================>.........] - ETA: 2s - loss: 0.7088 - acc: 0.7624
11776/15998 [=====================>........] - ETA: 2s - loss: 0.7109 - acc: 0.7617
11904/15998 [=====================>........] - ETA: 2s - loss: 0.7131 - acc: 0.7611
12032/15998 [=====================>........] - ETA: 2s - loss: 0.7125 - acc: 0.7618
12160/15998 [=====================>........] - ETA: 1s - loss: 0.7112 - acc: 0.7619
12288/15998 [======================>.......] - ETA: 1s - loss: 0.7102 - acc: 0.7625
12416/15998 [======================>.......] - ETA: 1s - loss: 0.7090 - acc: 0.7626
12544/15998 [======================>.......] - ETA: 1s - loss: 0.7096 - acc: 0.7620
12672/15998 [======================>.......] - ETA: 1s - loss: 0.7112 - acc: 0.7614
12800/15998 [=======================>......] - ETA: 1s - loss: 0.7107 - acc: 0.7617
12928/15998 [=======================>......] - ETA: 1s - loss: 0.7116 - acc: 0.7614
13056/15998 [=======================>......] - ETA: 1s - loss: 0.7138 - acc: 0.7608
13184/15998 [=======================>......] - ETA: 1s - loss: 0.7149 - acc: 0.7605
13312/15998 [=======================>......] - ETA: 1s - loss: 0.7139 - acc: 0.7607
13440/15998 [========================>.....] - ETA: 1s - loss: 0.7122 - acc: 0.7612
13568/15998 [========================>.....] - ETA: 1s - loss: 0.7100 - acc: 0.7618
13696/15998 [========================>.....] - ETA: 1s - loss: 0.7080 - acc: 0.7619
13824/15998 [========================>.....] - ETA: 1s - loss: 0.7091 - acc: 0.7612
13952/15998 [=========================>....] - ETA: 1s - loss: 0.7138 - acc: 0.7599
14080/15998 [=========================>....] - ETA: 0s - loss: 0.7161 - acc: 0.7589
14208/15998 [=========================>....] - ETA: 0s - loss: 0.7162 - acc: 0.7587
14336/15998 [=========================>....] - ETA: 0s - loss: 0.7185 - acc: 0.7579
14464/15998 [==========================>...] - ETA: 0s - loss: 0.7184 - acc: 0.7584
14592/15998 [==========================>...] - ETA: 0s - loss: 0.7174 - acc: 0.7589
14720/15998 [==========================>...] - ETA: 0s - loss: 0.7171 - acc: 0.7590
14848/15998 [==========================>...] - ETA: 0s - loss: 0.7157 - acc: 0.7596
14976/15998 [===========================>..] - ETA: 0s - loss: 0.7146 - acc: 0.7600
15104/15998 [===========================>..] - ETA: 0s - loss: 0.7139 - acc: 0.7604
15232/15998 [===========================>..] - ETA: 0s - loss: 0.7124 - acc: 0.7609
15360/15998 [===========================>..] - ETA: 0s - loss: 0.7125 - acc: 0.7609
15488/15998 [============================>.] - ETA: 0s - loss: 0.7142 - acc: 0.7604
15616/15998 [============================>.] - ETA: 0s - loss: 0.7157 - acc: 0.7599
15744/15998 [============================>.] - ETA: 0s - loss: 0.7163 - acc: 0.7600
15872/15998 [============================>.] - ETA: 0s - loss: 0.7170 - acc: 0.7598
15998/15998 [==============================] - 9s 558us/step - loss: 0.7168 - acc: 0.7600 - val_loss: 0.8966 - val_acc: 0.7147
Epoch 7/10128/15998 [..............................] - ETA: 7s - loss: 0.5712 - acc: 0.8047256/15998 [..............................] - ETA: 7s - loss: 0.5291 - acc: 0.8164384/15998 [..............................] - ETA: 7s - loss: 0.5010 - acc: 0.8255512/15998 [..............................] - ETA: 7s - loss: 0.5150 - acc: 0.8203640/15998 [>.............................] - ETA: 7s - loss: 0.5228 - acc: 0.8187768/15998 [>.............................] - ETA: 7s - loss: 0.5242 - acc: 0.8112896/15998 [>.............................] - ETA: 7s - loss: 0.5497 - acc: 0.80361024/15998 [>.............................] - ETA: 7s - loss: 0.5680 - acc: 0.79591152/15998 [=>............................] - ETA: 7s - loss: 0.5843 - acc: 0.78651280/15998 [=>............................] - ETA: 7s - loss: 0.5878 - acc: 0.78751408/15998 [=>............................] - ETA: 7s - loss: 0.5920 - acc: 0.78691536/15998 [=>............................] - ETA: 7s - loss: 0.5914 - acc: 0.79041664/15998 [==>...........................] - ETA: 7s - loss: 0.5902 - acc: 0.79151792/15998 [==>...........................] - ETA: 7s - loss: 0.5825 - acc: 0.79411920/15998 [==>...........................] - ETA: 7s - loss: 0.5746 - acc: 0.79692048/15998 [==>...........................] - ETA: 7s - loss: 0.5714 - acc: 0.79742176/15998 [===>..........................] - ETA: 6s - loss: 0.5762 - acc: 0.79642304/15998 [===>..........................] - ETA: 6s - loss: 0.5788 - acc: 0.79512432/15998 [===>..........................] - ETA: 6s - loss: 0.5894 - acc: 0.79072560/15998 [===>..........................] - ETA: 6s - loss: 0.5961 - acc: 0.78872688/15998 [====>.........................] - ETA: 6s - loss: 0.5947 - acc: 0.79092816/15998 [====>.........................] - ETA: 6s - loss: 0.5914 - acc: 0.79402944/15998 [====>.........................] - ETA: 6s - loss: 0.5957 - acc: 0.79253072/15998 [====>.........................] - ETA: 6s - loss: 0.5953 - acc: 0.78973200/15998 [=====>........................] - ETA: 6s - loss: 0.5918 - acc: 0.79003328/15998 [=====>........................] - ETA: 6s - loss: 0.5943 - acc: 0.79033456/15998 [=====>........................] - ETA: 6s - loss: 0.5955 - acc: 0.79203584/15998 [=====>........................] - ETA: 6s - loss: 0.5960 - acc: 0.79243712/15998 [=====>........................] - ETA: 6s - loss: 0.5939 - acc: 0.79123840/15998 [======>.......................] - ETA: 6s - loss: 0.5916 - acc: 0.79403968/15998 [======>.......................] - ETA: 6s - loss: 0.5845 - acc: 0.79664096/15998 [======>.......................] - ETA: 6s - loss: 0.5829 - acc: 0.79864224/15998 [======>.......................] - ETA: 5s - loss: 0.5815 - acc: 0.79954352/15998 [=======>......................] - ETA: 5s - loss: 0.5804 - acc: 0.79964480/15998 [=======>......................] - ETA: 5s - loss: 0.5908 - acc: 0.79644608/15998 [=======>......................] - ETA: 5s - loss: 0.6040 - acc: 0.79254736/15998 [=======>......................] - ETA: 5s - loss: 0.6122 - acc: 0.79084864/15998 [========>.....................] - ETA: 5s - loss: 0.6124 - acc: 0.79114992/15998 [========>.....................] - ETA: 5s - loss: 0.6101 - acc: 0.79275120/15998 [========>.....................] - ETA: 5s - loss: 0.6099 - acc: 0.79265248/15998 [========>.....................] - ETA: 5s - loss: 0.6079 - acc: 0.79385376/15998 [=========>....................] - ETA: 5s - loss: 0.6069 - acc: 0.79435504/15998 [=========>....................] - ETA: 5s - loss: 0.6077 - acc: 0.79455632/15998 [=========>....................] - ETA: 5s - loss: 0.6100 - acc: 0.79375760/15998 [=========>....................] - ETA: 5s - loss: 0.6139 - acc: 0.79225888/15998 [==========>...................] - ETA: 5s - loss: 0.6151 - acc: 0.79036016/15998 [==========>...................] - ETA: 5s - loss: 0.6190 - acc: 0.78816144/15998 [==========>...................] - ETA: 4s - loss: 0.6217 - acc: 0.78796272/15998 [==========>...................] - ETA: 4s - loss: 0.6179 - acc: 0.78946400/15998 [===========>..................] - ETA: 4s - loss: 0.6193 - acc: 0.78876528/15998 [===========>..................] - ETA: 4s - loss: 0.6160 - acc: 0.79006656/15998 [===========>..................] - ETA: 4s - loss: 0.6136 - acc: 0.79016784/15998 [===========>..................] - ETA: 4s - loss: 0.6129 - acc: 0.79076912/15998 [===========>..................] - ETA: 4s - loss: 0.6116 - acc: 0.79187040/15998 [============>.................] - ETA: 4s - loss: 0.6103 - acc: 0.79187168/15998 [============>.................] - ETA: 4s - loss: 0.6105 - acc: 0.79167296/15998 [============>.................] - ETA: 4s - loss: 0.6098 - acc: 0.79187424/15998 [============>.................] - ETA: 4s - loss: 0.6099 - acc: 0.79167552/15998 [=============>................] - ETA: 4s - loss: 0.6123 - acc: 0.79077680/15998 [=============>................] - ETA: 4s - loss: 0.6081 - acc: 0.79217808/15998 [=============>................] - ETA: 4s - loss: 0.6071 - acc: 0.79287936/15998 [=============>................] - ETA: 4s - loss: 0.6071 - acc: 0.79288064/15998 [==============>...............] - ETA: 4s - loss: 0.6094 - acc: 0.79138192/15998 [==============>...............] - ETA: 3s - loss: 0.6117 - acc: 0.79138320/15998 [==============>...............] - ETA: 3s - loss: 0.6117 - acc: 0.79108448/15998 [==============>...............] - ETA: 3s - loss: 0.6098 - acc: 0.79158576/15998 [===============>..............] - ETA: 3s - loss: 0.6070 - acc: 0.79278704/15998 [===============>..............] - ETA: 3s - loss: 0.6057 - acc: 0.79318832/15998 [===============>..............] - ETA: 3s - loss: 0.6066 - acc: 0.79288960/15998 [===============>..............] - ETA: 3s - loss: 0.6073 - acc: 0.79229088/15998 [================>.............] - ETA: 3s - loss: 0.6059 - acc: 0.79299216/15998 [================>.............] - ETA: 3s - loss: 0.6047 - acc: 0.79369344/15998 [================>.............] - ETA: 3s - loss: 0.6051 - acc: 0.79429472/15998 [================>.............] - ETA: 3s - loss: 0.6035 - acc: 0.79469600/15998 [=================>............] - ETA: 3s - loss: 0.6025 - acc: 0.79539728/15998 [=================>............] - ETA: 3s - loss: 0.6026 - acc: 0.79529856/15998 [=================>............] - ETA: 3s - loss: 0.6052 - acc: 0.79369984/15998 [=================>............] - ETA: 3s - loss: 0.6063 - acc: 0.7932
10112/15998 [=================>............] - ETA: 2s - loss: 0.6058 - acc: 0.7932
10240/15998 [==================>...........] - ETA: 2s - loss: 0.6058 - acc: 0.7931
10368/15998 [==================>...........] - ETA: 2s - loss: 0.6061 - acc: 0.7928
10496/15998 [==================>...........] - ETA: 2s - loss: 0.6053 - acc: 0.7929
10624/15998 [==================>...........] - ETA: 2s - loss: 0.6054 - acc: 0.7928
10752/15998 [===================>..........] - ETA: 2s - loss: 0.6044 - acc: 0.7932
10880/15998 [===================>..........] - ETA: 2s - loss: 0.6039 - acc: 0.7939
11008/15998 [===================>..........] - ETA: 2s - loss: 0.6024 - acc: 0.7945
11136/15998 [===================>..........] - ETA: 2s - loss: 0.6014 - acc: 0.7952
11264/15998 [====================>.........] - ETA: 2s - loss: 0.5998 - acc: 0.7958
11392/15998 [====================>.........] - ETA: 2s - loss: 0.5982 - acc: 0.7964
11520/15998 [====================>.........] - ETA: 2s - loss: 0.5972 - acc: 0.7967
11648/15998 [====================>.........] - ETA: 2s - loss: 0.5976 - acc: 0.7968
11776/15998 [=====================>........] - ETA: 2s - loss: 0.5992 - acc: 0.7963
11904/15998 [=====================>........] - ETA: 2s - loss: 0.5997 - acc: 0.7960
12032/15998 [=====================>........] - ETA: 2s - loss: 0.5999 - acc: 0.7960
12160/15998 [=====================>........] - ETA: 1s - loss: 0.5998 - acc: 0.7960
12288/15998 [======================>.......] - ETA: 1s - loss: 0.5999 - acc: 0.7961
12416/15998 [======================>.......] - ETA: 1s - loss: 0.6011 - acc: 0.7953
12544/15998 [======================>.......] - ETA: 1s - loss: 0.6052 - acc: 0.7938
12672/15998 [======================>.......] - ETA: 1s - loss: 0.6067 - acc: 0.7932
12800/15998 [=======================>......] - ETA: 1s - loss: 0.6069 - acc: 0.7930
12928/15998 [=======================>......] - ETA: 1s - loss: 0.6062 - acc: 0.7932
13056/15998 [=======================>......] - ETA: 1s - loss: 0.6052 - acc: 0.7933
13184/15998 [=======================>......] - ETA: 1s - loss: 0.6047 - acc: 0.7936
13312/15998 [=======================>......] - ETA: 1s - loss: 0.6032 - acc: 0.7939
13440/15998 [========================>.....] - ETA: 1s - loss: 0.6028 - acc: 0.7939
13568/15998 [========================>.....] - ETA: 1s - loss: 0.6046 - acc: 0.7937
13696/15998 [========================>.....] - ETA: 1s - loss: 0.6054 - acc: 0.7934
13824/15998 [========================>.....] - ETA: 1s - loss: 0.6046 - acc: 0.7936
13952/15998 [=========================>....] - ETA: 1s - loss: 0.6028 - acc: 0.7941
14080/15998 [=========================>....] - ETA: 0s - loss: 0.6019 - acc: 0.7945
14208/15998 [=========================>....] - ETA: 0s - loss: 0.6023 - acc: 0.7943
14336/15998 [=========================>....] - ETA: 0s - loss: 0.6026 - acc: 0.7945
14464/15998 [==========================>...] - ETA: 0s - loss: 0.6021 - acc: 0.7946
14592/15998 [==========================>...] - ETA: 0s - loss: 0.6026 - acc: 0.7943
14720/15998 [==========================>...] - ETA: 0s - loss: 0.6028 - acc: 0.7940
14848/15998 [==========================>...] - ETA: 0s - loss: 0.6020 - acc: 0.7940
14976/15998 [===========================>..] - ETA: 0s - loss: 0.6007 - acc: 0.7948
15104/15998 [===========================>..] - ETA: 0s - loss: 0.6012 - acc: 0.7946
15232/15998 [===========================>..] - ETA: 0s - loss: 0.6018 - acc: 0.7942
15360/15998 [===========================>..] - ETA: 0s - loss: 0.6030 - acc: 0.7935
15488/15998 [============================>.] - ETA: 0s - loss: 0.6045 - acc: 0.7929
15616/15998 [============================>.] - ETA: 0s - loss: 0.6060 - acc: 0.7919
15744/15998 [============================>.] - ETA: 0s - loss: 0.6063 - acc: 0.7915
15872/15998 [============================>.] - ETA: 0s - loss: 0.6054 - acc: 0.7919
15998/15998 [==============================] - 9s 558us/step - loss: 0.6055 - acc: 0.7917 - val_loss: 0.9708 - val_acc: 0.6957
Epoch 8/10128/15998 [..............................] - ETA: 8s - loss: 0.5848 - acc: 0.8438256/15998 [..............................] - ETA: 8s - loss: 0.4698 - acc: 0.8750384/15998 [..............................] - ETA: 7s - loss: 0.4496 - acc: 0.8776512/15998 [..............................] - ETA: 7s - loss: 0.4409 - acc: 0.8730640/15998 [>.............................] - ETA: 7s - loss: 0.4466 - acc: 0.8594768/15998 [>.............................] - ETA: 7s - loss: 0.4539 - acc: 0.8555896/15998 [>.............................] - ETA: 7s - loss: 0.4467 - acc: 0.85161024/15998 [>.............................] - ETA: 7s - loss: 0.4512 - acc: 0.84671152/15998 [=>............................] - ETA: 7s - loss: 0.4490 - acc: 0.85331280/15998 [=>............................] - ETA: 7s - loss: 0.4587 - acc: 0.84841408/15998 [=>............................] - ETA: 7s - loss: 0.4596 - acc: 0.84451536/15998 [=>............................] - ETA: 7s - loss: 0.4711 - acc: 0.83851664/15998 [==>...........................] - ETA: 7s - loss: 0.4740 - acc: 0.83831792/15998 [==>...........................] - ETA: 7s - loss: 0.4789 - acc: 0.83821920/15998 [==>...........................] - ETA: 7s - loss: 0.4879 - acc: 0.83542048/15998 [==>...........................] - ETA: 7s - loss: 0.4888 - acc: 0.83452176/15998 [===>..........................] - ETA: 7s - loss: 0.4983 - acc: 0.83092304/15998 [===>..........................] - ETA: 7s - loss: 0.5127 - acc: 0.82342432/15998 [===>..........................] - ETA: 6s - loss: 0.5192 - acc: 0.82282560/15998 [===>..........................] - ETA: 6s - loss: 0.5194 - acc: 0.82232688/15998 [====>.........................] - ETA: 6s - loss: 0.5146 - acc: 0.82402816/15998 [====>.........................] - ETA: 6s - loss: 0.5081 - acc: 0.82712944/15998 [====>.........................] - ETA: 6s - loss: 0.5042 - acc: 0.82813072/15998 [====>.........................] - ETA: 6s - loss: 0.5018 - acc: 0.82883200/15998 [=====>........................] - ETA: 6s - loss: 0.5018 - acc: 0.82913328/15998 [=====>........................] - ETA: 6s - loss: 0.5009 - acc: 0.82963456/15998 [=====>........................] - ETA: 6s - loss: 0.5022 - acc: 0.82813584/15998 [=====>........................] - ETA: 6s - loss: 0.5002 - acc: 0.82763712/15998 [=====>........................] - ETA: 6s - loss: 0.4985 - acc: 0.82813840/15998 [======>.......................] - ETA: 6s - loss: 0.5014 - acc: 0.82793968/15998 [======>.......................] - ETA: 6s - loss: 0.5047 - acc: 0.82714096/15998 [======>.......................] - ETA: 6s - loss: 0.5075 - acc: 0.82454224/15998 [======>.......................] - ETA: 6s - loss: 0.5112 - acc: 0.82344352/15998 [=======>......................] - ETA: 5s - loss: 0.5132 - acc: 0.82284480/15998 [=======>......................] - ETA: 5s - loss: 0.5083 - acc: 0.82524608/15998 [=======>......................] - ETA: 5s - loss: 0.5070 - acc: 0.82644736/15998 [=======>......................] - ETA: 5s - loss: 0.5019 - acc: 0.82834864/15998 [========>.....................] - ETA: 5s - loss: 0.5027 - acc: 0.82774992/15998 [========>.....................] - ETA: 5s - loss: 0.5047 - acc: 0.82635120/15998 [========>.....................] - ETA: 5s - loss: 0.5081 - acc: 0.82625248/15998 [========>.....................] - ETA: 5s - loss: 0.5062 - acc: 0.82775376/15998 [=========>....................] - ETA: 5s - loss: 0.5018 - acc: 0.82945504/15998 [=========>....................] - ETA: 5s - loss: 0.5005 - acc: 0.82945632/15998 [=========>....................] - ETA: 5s - loss: 0.4992 - acc: 0.82975760/15998 [=========>....................] - ETA: 5s - loss: 0.4970 - acc: 0.83095888/15998 [==========>...................] - ETA: 5s - loss: 0.4995 - acc: 0.82956016/15998 [==========>...................] - ETA: 5s - loss: 0.5028 - acc: 0.82786144/15998 [==========>...................] - ETA: 5s - loss: 0.5040 - acc: 0.82756272/15998 [==========>...................] - ETA: 4s - loss: 0.5028 - acc: 0.82816400/15998 [===========>..................] - ETA: 4s - loss: 0.5046 - acc: 0.82806528/15998 [===========>..................] - ETA: 4s - loss: 0.5040 - acc: 0.82816656/15998 [===========>..................] - ETA: 4s - loss: 0.5058 - acc: 0.82776784/15998 [===========>..................] - ETA: 4s - loss: 0.5061 - acc: 0.82756912/15998 [===========>..................] - ETA: 4s - loss: 0.5031 - acc: 0.82887040/15998 [============>.................] - ETA: 4s - loss: 0.5016 - acc: 0.82957168/15998 [============>.................] - ETA: 4s - loss: 0.4998 - acc: 0.82977296/15998 [============>.................] - ETA: 4s - loss: 0.5042 - acc: 0.82807424/15998 [============>.................] - ETA: 4s - loss: 0.5091 - acc: 0.82577552/15998 [=============>................] - ETA: 4s - loss: 0.5108 - acc: 0.82517680/15998 [=============>................] - ETA: 4s - loss: 0.5090 - acc: 0.82547808/15998 [=============>................] - ETA: 4s - loss: 0.5086 - acc: 0.82617936/15998 [=============>................] - ETA: 4s - loss: 0.5101 - acc: 0.82508064/15998 [==============>...............] - ETA: 4s - loss: 0.5114 - acc: 0.82428192/15998 [==============>...............] - ETA: 3s - loss: 0.5109 - acc: 0.82408320/15998 [==============>...............] - ETA: 3s - loss: 0.5132 - acc: 0.82278448/15998 [==============>...............] - ETA: 3s - loss: 0.5119 - acc: 0.82358576/15998 [===============>..............] - ETA: 3s - loss: 0.5099 - acc: 0.82448704/15998 [===============>..............] - ETA: 3s - loss: 0.5096 - acc: 0.82448832/15998 [===============>..............] - ETA: 3s - loss: 0.5082 - acc: 0.82508960/15998 [===============>..............] - ETA: 3s - loss: 0.5065 - acc: 0.82589088/15998 [================>.............] - ETA: 3s - loss: 0.5067 - acc: 0.82549216/15998 [================>.............] - ETA: 3s - loss: 0.5102 - acc: 0.82419344/15998 [================>.............] - ETA: 3s - loss: 0.5102 - acc: 0.82469472/15998 [================>.............] - ETA: 3s - loss: 0.5100 - acc: 0.82429600/15998 [=================>............] - ETA: 3s - loss: 0.5095 - acc: 0.82409728/15998 [=================>............] - ETA: 3s - loss: 0.5098 - acc: 0.82419856/15998 [=================>............] - ETA: 3s - loss: 0.5088 - acc: 0.82439984/15998 [=================>............] - ETA: 3s - loss: 0.5093 - acc: 0.8238
10112/15998 [=================>............] - ETA: 3s - loss: 0.5123 - acc: 0.8227
10240/15998 [==================>...........] - ETA: 2s - loss: 0.5127 - acc: 0.8226
10368/15998 [==================>...........] - ETA: 2s - loss: 0.5098 - acc: 0.8233
10496/15998 [==================>...........] - ETA: 2s - loss: 0.5073 - acc: 0.8242
10624/15998 [==================>...........] - ETA: 2s - loss: 0.5054 - acc: 0.8249
10752/15998 [===================>..........] - ETA: 2s - loss: 0.5075 - acc: 0.8248
10880/15998 [===================>..........] - ETA: 2s - loss: 0.5094 - acc: 0.8240
11008/15998 [===================>..........] - ETA: 2s - loss: 0.5122 - acc: 0.8225
11136/15998 [===================>..........] - ETA: 2s - loss: 0.5126 - acc: 0.8226
11264/15998 [====================>.........] - ETA: 2s - loss: 0.5142 - acc: 0.8225
11392/15998 [====================>.........] - ETA: 2s - loss: 0.5134 - acc: 0.8223
11520/15998 [====================>.........] - ETA: 2s - loss: 0.5129 - acc: 0.8226
11648/15998 [====================>.........] - ETA: 2s - loss: 0.5131 - acc: 0.8225
11776/15998 [=====================>........] - ETA: 2s - loss: 0.5135 - acc: 0.8227
11904/15998 [=====================>........] - ETA: 2s - loss: 0.5120 - acc: 0.8231
12032/15998 [=====================>........] - ETA: 2s - loss: 0.5103 - acc: 0.8238
12160/15998 [=====================>........] - ETA: 1s - loss: 0.5103 - acc: 0.8237
12288/15998 [======================>.......] - ETA: 1s - loss: 0.5124 - acc: 0.8229
12416/15998 [======================>.......] - ETA: 1s - loss: 0.5128 - acc: 0.8227
12544/15998 [======================>.......] - ETA: 1s - loss: 0.5163 - acc: 0.8219
12672/15998 [======================>.......] - ETA: 1s - loss: 0.5162 - acc: 0.8219
12800/15998 [=======================>......] - ETA: 1s - loss: 0.5162 - acc: 0.8217
12928/15998 [=======================>......] - ETA: 1s - loss: 0.5155 - acc: 0.8219
13056/15998 [=======================>......] - ETA: 1s - loss: 0.5147 - acc: 0.8221
13184/15998 [=======================>......] - ETA: 1s - loss: 0.5133 - acc: 0.8229
13312/15998 [=======================>......] - ETA: 1s - loss: 0.5127 - acc: 0.8229
13440/15998 [========================>.....] - ETA: 1s - loss: 0.5119 - acc: 0.8234
13568/15998 [========================>.....] - ETA: 1s - loss: 0.5127 - acc: 0.8235
13696/15998 [========================>.....] - ETA: 1s - loss: 0.5142 - acc: 0.8224
13824/15998 [========================>.....] - ETA: 1s - loss: 0.5148 - acc: 0.8222
13952/15998 [=========================>....] - ETA: 1s - loss: 0.5146 - acc: 0.8224
14080/15998 [=========================>....] - ETA: 0s - loss: 0.5139 - acc: 0.8230
14208/15998 [=========================>....] - ETA: 0s - loss: 0.5128 - acc: 0.8236
14336/15998 [=========================>....] - ETA: 0s - loss: 0.5132 - acc: 0.8235
14464/15998 [==========================>...] - ETA: 0s - loss: 0.5138 - acc: 0.8235
14592/15998 [==========================>...] - ETA: 0s - loss: 0.5153 - acc: 0.8230
14720/15998 [==========================>...] - ETA: 0s - loss: 0.5156 - acc: 0.8231
14848/15998 [==========================>...] - ETA: 0s - loss: 0.5155 - acc: 0.8229
14976/15998 [===========================>..] - ETA: 0s - loss: 0.5147 - acc: 0.8228
15104/15998 [===========================>..] - ETA: 0s - loss: 0.5140 - acc: 0.8229
15232/15998 [===========================>..] - ETA: 0s - loss: 0.5139 - acc: 0.8232
15360/15998 [===========================>..] - ETA: 0s - loss: 0.5133 - acc: 0.8234
15488/15998 [============================>.] - ETA: 0s - loss: 0.5119 - acc: 0.8241
15616/15998 [============================>.] - ETA: 0s - loss: 0.5110 - acc: 0.8246
15744/15998 [============================>.] - ETA: 0s - loss: 0.5113 - acc: 0.8242
15872/15998 [============================>.] - ETA: 0s - loss: 0.5163 - acc: 0.8229
15998/15998 [==============================] - 9s 559us/step - loss: 0.5183 - acc: 0.8224 - val_loss: 1.0839 - val_acc: 0.6692
Epoch 9/10128/15998 [..............................] - ETA: 8s - loss: 0.4888 - acc: 0.8516256/15998 [..............................] - ETA: 7s - loss: 0.4361 - acc: 0.8516384/15998 [..............................] - ETA: 7s - loss: 0.4150 - acc: 0.8568512/15998 [..............................] - ETA: 7s - loss: 0.4276 - acc: 0.8555640/15998 [>.............................] - ETA: 7s - loss: 0.4024 - acc: 0.8656768/15998 [>.............................] - ETA: 7s - loss: 0.3762 - acc: 0.8750896/15998 [>.............................] - ETA: 7s - loss: 0.3715 - acc: 0.88061024/15998 [>.............................] - ETA: 7s - loss: 0.3590 - acc: 0.88671152/15998 [=>............................] - ETA: 7s - loss: 0.3782 - acc: 0.87931280/15998 [=>............................] - ETA: 7s - loss: 0.3751 - acc: 0.87971408/15998 [=>............................] - ETA: 7s - loss: 0.3740 - acc: 0.88211536/15998 [=>............................] - ETA: 7s - loss: 0.3781 - acc: 0.88091664/15998 [==>...........................] - ETA: 7s - loss: 0.3885 - acc: 0.87741792/15998 [==>...........................] - ETA: 7s - loss: 0.4024 - acc: 0.87391920/15998 [==>...........................] - ETA: 7s - loss: 0.4006 - acc: 0.87452048/15998 [==>...........................] - ETA: 7s - loss: 0.4007 - acc: 0.87402176/15998 [===>..........................] - ETA: 6s - loss: 0.3995 - acc: 0.87502304/15998 [===>..........................] - ETA: 6s - loss: 0.3899 - acc: 0.87892432/15998 [===>..........................] - ETA: 6s - loss: 0.3877 - acc: 0.87992560/15998 [===>..........................] - ETA: 6s - loss: 0.3927 - acc: 0.87662688/15998 [====>.........................] - ETA: 6s - loss: 0.3892 - acc: 0.87802816/15998 [====>.........................] - ETA: 6s - loss: 0.3934 - acc: 0.87682944/15998 [====>.........................] - ETA: 6s - loss: 0.3921 - acc: 0.87773072/15998 [====>.........................] - ETA: 6s - loss: 0.3962 - acc: 0.87403200/15998 [=====>........................] - ETA: 6s - loss: 0.4025 - acc: 0.87093328/15998 [=====>........................] - ETA: 6s - loss: 0.4083 - acc: 0.86933456/15998 [=====>........................] - ETA: 6s - loss: 0.4121 - acc: 0.86783584/15998 [=====>........................] - ETA: 6s - loss: 0.4164 - acc: 0.86643712/15998 [=====>........................] - ETA: 6s - loss: 0.4148 - acc: 0.86583840/15998 [======>.......................] - ETA: 6s - loss: 0.4113 - acc: 0.86673968/15998 [======>.......................] - ETA: 6s - loss: 0.4088 - acc: 0.86624096/15998 [======>.......................] - ETA: 6s - loss: 0.4085 - acc: 0.86654224/15998 [======>.......................] - ETA: 5s - loss: 0.4116 - acc: 0.86534352/15998 [=======>......................] - ETA: 5s - loss: 0.4133 - acc: 0.86404480/15998 [=======>......................] - ETA: 5s - loss: 0.4214 - acc: 0.86094608/15998 [=======>......................] - ETA: 5s - loss: 0.4292 - acc: 0.85744736/15998 [=======>......................] - ETA: 5s - loss: 0.4302 - acc: 0.85644864/15998 [========>.....................] - ETA: 5s - loss: 0.4307 - acc: 0.85674992/15998 [========>.....................] - ETA: 5s - loss: 0.4270 - acc: 0.85885120/15998 [========>.....................] - ETA: 5s - loss: 0.4277 - acc: 0.85805248/15998 [========>.....................] - ETA: 5s - loss: 0.4242 - acc: 0.85885376/15998 [=========>....................] - ETA: 5s - loss: 0.4227 - acc: 0.85925504/15998 [=========>....................] - ETA: 5s - loss: 0.4240 - acc: 0.85885632/15998 [=========>....................] - ETA: 5s - loss: 0.4226 - acc: 0.85945760/15998 [=========>....................] - ETA: 5s - loss: 0.4223 - acc: 0.85905888/15998 [==========>...................] - ETA: 5s - loss: 0.4212 - acc: 0.85956016/15998 [==========>...................] - ETA: 5s - loss: 0.4241 - acc: 0.85806144/15998 [==========>...................] - ETA: 5s - loss: 0.4234 - acc: 0.85826272/15998 [==========>...................] - ETA: 4s - loss: 0.4202 - acc: 0.85956400/15998 [===========>..................] - ETA: 4s - loss: 0.4206 - acc: 0.85956528/15998 [===========>..................] - ETA: 4s - loss: 0.4215 - acc: 0.85886656/15998 [===========>..................] - ETA: 4s - loss: 0.4192 - acc: 0.85986784/15998 [===========>..................] - ETA: 4s - loss: 0.4169 - acc: 0.86066912/15998 [===========>..................] - ETA: 4s - loss: 0.4148 - acc: 0.86117040/15998 [============>.................] - ETA: 4s - loss: 0.4139 - acc: 0.86097168/15998 [============>.................] - ETA: 4s - loss: 0.4144 - acc: 0.86057296/15998 [============>.................] - ETA: 4s - loss: 0.4149 - acc: 0.86067424/15998 [============>.................] - ETA: 4s - loss: 0.4187 - acc: 0.85927552/15998 [=============>................] - ETA: 4s - loss: 0.4216 - acc: 0.85867680/15998 [=============>................] - ETA: 4s - loss: 0.4241 - acc: 0.85817808/15998 [=============>................] - ETA: 4s - loss: 0.4224 - acc: 0.85897936/15998 [=============>................] - ETA: 4s - loss: 0.4208 - acc: 0.85988064/15998 [==============>...............] - ETA: 4s - loss: 0.4211 - acc: 0.85958192/15998 [==============>...............] - ETA: 3s - loss: 0.4206 - acc: 0.85958320/15998 [==============>...............] - ETA: 3s - loss: 0.4198 - acc: 0.85958448/15998 [==============>...............] - ETA: 3s - loss: 0.4204 - acc: 0.85908576/15998 [===============>..............] - ETA: 3s - loss: 0.4253 - acc: 0.85778704/15998 [===============>..............] - ETA: 3s - loss: 0.4258 - acc: 0.85778832/15998 [===============>..............] - ETA: 3s - loss: 0.4244 - acc: 0.85848960/15998 [===============>..............] - ETA: 3s - loss: 0.4228 - acc: 0.85929088/15998 [================>.............] - ETA: 3s - loss: 0.4241 - acc: 0.85869216/15998 [================>.............] - ETA: 3s - loss: 0.4233 - acc: 0.85879344/15998 [================>.............] - ETA: 3s - loss: 0.4244 - acc: 0.85839472/15998 [================>.............] - ETA: 3s - loss: 0.4233 - acc: 0.85839600/15998 [=================>............] - ETA: 3s - loss: 0.4253 - acc: 0.85759728/15998 [=================>............] - ETA: 3s - loss: 0.4258 - acc: 0.85749856/15998 [=================>............] - ETA: 3s - loss: 0.4270 - acc: 0.85699984/15998 [=================>............] - ETA: 3s - loss: 0.4284 - acc: 0.8563
10112/15998 [=================>............] - ETA: 2s - loss: 0.4305 - acc: 0.8554
10240/15998 [==================>...........] - ETA: 2s - loss: 0.4330 - acc: 0.8547
10368/15998 [==================>...........] - ETA: 2s - loss: 0.4376 - acc: 0.8533
10496/15998 [==================>...........] - ETA: 2s - loss: 0.4415 - acc: 0.8522
10624/15998 [==================>...........] - ETA: 2s - loss: 0.4448 - acc: 0.8508
10752/15998 [===================>..........] - ETA: 2s - loss: 0.4437 - acc: 0.8512
10880/15998 [===================>..........] - ETA: 2s - loss: 0.4435 - acc: 0.8514
11008/15998 [===================>..........] - ETA: 2s - loss: 0.4431 - acc: 0.8516
11136/15998 [===================>..........] - ETA: 2s - loss: 0.4420 - acc: 0.8519
11264/15998 [====================>.........] - ETA: 2s - loss: 0.4406 - acc: 0.8524
11392/15998 [====================>.........] - ETA: 2s - loss: 0.4395 - acc: 0.8527
11520/15998 [====================>.........] - ETA: 2s - loss: 0.4387 - acc: 0.8531
11648/15998 [====================>.........] - ETA: 2s - loss: 0.4371 - acc: 0.8535
11776/15998 [=====================>........] - ETA: 2s - loss: 0.4367 - acc: 0.8537
11904/15998 [=====================>........] - ETA: 2s - loss: 0.4358 - acc: 0.8540
12032/15998 [=====================>........] - ETA: 2s - loss: 0.4343 - acc: 0.8546
12160/15998 [=====================>........] - ETA: 1s - loss: 0.4333 - acc: 0.8549
12288/15998 [======================>.......] - ETA: 1s - loss: 0.4367 - acc: 0.8538
12416/15998 [======================>.......] - ETA: 1s - loss: 0.4404 - acc: 0.8524
12544/15998 [======================>.......] - ETA: 1s - loss: 0.4390 - acc: 0.8530
12672/15998 [======================>.......] - ETA: 1s - loss: 0.4371 - acc: 0.8535
12800/15998 [=======================>......] - ETA: 1s - loss: 0.4366 - acc: 0.8533
12928/15998 [=======================>......] - ETA: 1s - loss: 0.4371 - acc: 0.8532
13056/15998 [=======================>......] - ETA: 1s - loss: 0.4367 - acc: 0.8535
13184/15998 [=======================>......] - ETA: 1s - loss: 0.4364 - acc: 0.8535
13312/15998 [=======================>......] - ETA: 1s - loss: 0.4360 - acc: 0.8533
13440/15998 [========================>.....] - ETA: 1s - loss: 0.4366 - acc: 0.8532
13568/15998 [========================>.....] - ETA: 1s - loss: 0.4370 - acc: 0.8531
13696/15998 [========================>.....] - ETA: 1s - loss: 0.4359 - acc: 0.8533
13824/15998 [========================>.....] - ETA: 1s - loss: 0.4351 - acc: 0.8538
13952/15998 [=========================>....] - ETA: 1s - loss: 0.4350 - acc: 0.8537
14080/15998 [=========================>....] - ETA: 0s - loss: 0.4368 - acc: 0.8531
14208/15998 [=========================>....] - ETA: 0s - loss: 0.4388 - acc: 0.8525
14336/15998 [=========================>....] - ETA: 0s - loss: 0.4399 - acc: 0.8520
14464/15998 [==========================>...] - ETA: 0s - loss: 0.4423 - acc: 0.8514
14592/15998 [==========================>...] - ETA: 0s - loss: 0.4417 - acc: 0.8514
14720/15998 [==========================>...] - ETA: 0s - loss: 0.4422 - acc: 0.8514
14848/15998 [==========================>...] - ETA: 0s - loss: 0.4411 - acc: 0.8517
14976/15998 [===========================>..] - ETA: 0s - loss: 0.4405 - acc: 0.8520
15104/15998 [===========================>..] - ETA: 0s - loss: 0.4398 - acc: 0.8520
15232/15998 [===========================>..] - ETA: 0s - loss: 0.4407 - acc: 0.8515
15360/15998 [===========================>..] - ETA: 0s - loss: 0.4408 - acc: 0.8516
15488/15998 [============================>.] - ETA: 0s - loss: 0.4400 - acc: 0.8518
15616/15998 [============================>.] - ETA: 0s - loss: 0.4401 - acc: 0.8519
15744/15998 [============================>.] - ETA: 0s - loss: 0.4407 - acc: 0.8516
15872/15998 [============================>.] - ETA: 0s - loss: 0.4409 - acc: 0.8516
15998/15998 [==============================] - 9s 558us/step - loss: 0.4422 - acc: 0.8514 - val_loss: 1.0354 - val_acc: 0.7007
Epoch 10/10128/15998 [..............................] - ETA: 7s - loss: 0.3569 - acc: 0.8672256/15998 [..............................] - ETA: 7s - loss: 0.3463 - acc: 0.8828384/15998 [..............................] - ETA: 7s - loss: 0.3560 - acc: 0.8828512/15998 [..............................] - ETA: 7s - loss: 0.3268 - acc: 0.8926640/15998 [>.............................] - ETA: 7s - loss: 0.3182 - acc: 0.8984768/15998 [>.............................] - ETA: 7s - loss: 0.3285 - acc: 0.8958896/15998 [>.............................] - ETA: 7s - loss: 0.3226 - acc: 0.89621024/15998 [>.............................] - ETA: 7s - loss: 0.3167 - acc: 0.89841152/15998 [=>............................] - ETA: 7s - loss: 0.3295 - acc: 0.89581280/15998 [=>............................] - ETA: 7s - loss: 0.3342 - acc: 0.89451408/15998 [=>............................] - ETA: 7s - loss: 0.3308 - acc: 0.89561536/15998 [=>............................] - ETA: 7s - loss: 0.3319 - acc: 0.89451664/15998 [==>...........................] - ETA: 7s - loss: 0.3206 - acc: 0.89841792/15998 [==>...........................] - ETA: 7s - loss: 0.3219 - acc: 0.89841920/15998 [==>...........................] - ETA: 7s - loss: 0.3366 - acc: 0.89382048/15998 [==>...........................] - ETA: 7s - loss: 0.3514 - acc: 0.88622176/15998 [===>..........................] - ETA: 7s - loss: 0.3637 - acc: 0.88422304/15998 [===>..........................] - ETA: 6s - loss: 0.3609 - acc: 0.88322432/15998 [===>..........................] - ETA: 6s - loss: 0.3562 - acc: 0.88402560/15998 [===>..........................] - ETA: 6s - loss: 0.3550 - acc: 0.88522688/15998 [====>.........................] - ETA: 6s - loss: 0.3505 - acc: 0.88582816/15998 [====>.........................] - ETA: 6s - loss: 0.3464 - acc: 0.88742944/15998 [====>.........................] - ETA: 6s - loss: 0.3460 - acc: 0.88693072/15998 [====>.........................] - ETA: 6s - loss: 0.3474 - acc: 0.88573200/15998 [=====>........................] - ETA: 6s - loss: 0.3495 - acc: 0.88503328/15998 [=====>........................] - ETA: 6s - loss: 0.3566 - acc: 0.88223456/15998 [=====>........................] - ETA: 6s - loss: 0.3559 - acc: 0.88253584/15998 [=====>........................] - ETA: 6s - loss: 0.3517 - acc: 0.88423712/15998 [=====>........................] - ETA: 6s - loss: 0.3548 - acc: 0.88343840/15998 [======>.......................] - ETA: 6s - loss: 0.3547 - acc: 0.88333968/15998 [======>.......................] - ETA: 6s - loss: 0.3531 - acc: 0.88364096/15998 [======>.......................] - ETA: 6s - loss: 0.3505 - acc: 0.88434224/15998 [======>.......................] - ETA: 6s - loss: 0.3453 - acc: 0.88664352/15998 [=======>......................] - ETA: 5s - loss: 0.3443 - acc: 0.88634480/15998 [=======>......................] - ETA: 5s - loss: 0.3423 - acc: 0.88754608/15998 [=======>......................] - ETA: 5s - loss: 0.3448 - acc: 0.88694736/15998 [=======>......................] - ETA: 5s - loss: 0.3546 - acc: 0.88344864/15998 [========>.....................] - ETA: 5s - loss: 0.3686 - acc: 0.87814992/15998 [========>.....................] - ETA: 5s - loss: 0.3814 - acc: 0.87385120/15998 [========>.....................] - ETA: 5s - loss: 0.3864 - acc: 0.87195248/15998 [========>.....................] - ETA: 5s - loss: 0.3878 - acc: 0.87085376/15998 [=========>....................] - ETA: 5s - loss: 0.3846 - acc: 0.87225504/15998 [=========>....................] - ETA: 5s - loss: 0.3840 - acc: 0.87215632/15998 [=========>....................] - ETA: 5s - loss: 0.3840 - acc: 0.87235760/15998 [=========>....................] - ETA: 5s - loss: 0.3824 - acc: 0.87245888/15998 [==========>...................] - ETA: 5s - loss: 0.3797 - acc: 0.87306016/15998 [==========>...................] - ETA: 5s - loss: 0.3761 - acc: 0.87436144/15998 [==========>...................] - ETA: 5s - loss: 0.3745 - acc: 0.87526272/15998 [==========>...................] - ETA: 4s - loss: 0.3707 - acc: 0.87646400/15998 [===========>..................] - ETA: 4s - loss: 0.3697 - acc: 0.87756528/15998 [===========>..................] - ETA: 4s - loss: 0.3679 - acc: 0.87816656/15998 [===========>..................] - ETA: 4s - loss: 0.3675 - acc: 0.87746784/15998 [===========>..................] - ETA: 4s - loss: 0.3674 - acc: 0.87686912/15998 [===========>..................] - ETA: 4s - loss: 0.3660 - acc: 0.87797040/15998 [============>.................] - ETA: 4s - loss: 0.3641 - acc: 0.87867168/15998 [============>.................] - ETA: 4s - loss: 0.3625 - acc: 0.87937296/15998 [============>.................] - ETA: 4s - loss: 0.3620 - acc: 0.87957424/15998 [============>.................] - ETA: 4s - loss: 0.3611 - acc: 0.87977552/15998 [=============>................] - ETA: 4s - loss: 0.3578 - acc: 0.88077680/15998 [=============>................] - ETA: 4s - loss: 0.3565 - acc: 0.88097808/15998 [=============>................] - ETA: 4s - loss: 0.3567 - acc: 0.88117936/15998 [=============>................] - ETA: 4s - loss: 0.3580 - acc: 0.88078064/15998 [==============>...............] - ETA: 4s - loss: 0.3597 - acc: 0.88038192/15998 [==============>...............] - ETA: 3s - loss: 0.3621 - acc: 0.87988320/15998 [==============>...............] - ETA: 3s - loss: 0.3621 - acc: 0.87998448/15998 [==============>...............] - ETA: 3s - loss: 0.3636 - acc: 0.87958576/15998 [===============>..............] - ETA: 3s - loss: 0.3648 - acc: 0.87908704/15998 [===============>..............] - ETA: 3s - loss: 0.3660 - acc: 0.87838832/15998 [===============>..............] - ETA: 3s - loss: 0.3669 - acc: 0.87798960/15998 [===============>..............] - ETA: 3s - loss: 0.3676 - acc: 0.87759088/15998 [================>.............] - ETA: 3s - loss: 0.3662 - acc: 0.87799216/15998 [================>.............] - ETA: 3s - loss: 0.3660 - acc: 0.87769344/15998 [================>.............] - ETA: 3s - loss: 0.3647 - acc: 0.87789472/15998 [================>.............] - ETA: 3s - loss: 0.3649 - acc: 0.87769600/15998 [=================>............] - ETA: 3s - loss: 0.3649 - acc: 0.87779728/15998 [=================>............] - ETA: 3s - loss: 0.3645 - acc: 0.87779856/15998 [=================>............] - ETA: 3s - loss: 0.3629 - acc: 0.87819984/15998 [=================>............] - ETA: 3s - loss: 0.3625 - acc: 0.8783
10112/15998 [=================>............] - ETA: 3s - loss: 0.3658 - acc: 0.8778
10240/15998 [==================>...........] - ETA: 2s - loss: 0.3672 - acc: 0.8770
10368/15998 [==================>...........] - ETA: 2s - loss: 0.3696 - acc: 0.8764
10496/15998 [==================>...........] - ETA: 2s - loss: 0.3726 - acc: 0.8755
10624/15998 [==================>...........] - ETA: 2s - loss: 0.3729 - acc: 0.8758
10752/15998 [===================>..........] - ETA: 2s - loss: 0.3717 - acc: 0.8757
10880/15998 [===================>..........] - ETA: 2s - loss: 0.3718 - acc: 0.8754
11008/15998 [===================>..........] - ETA: 2s - loss: 0.3703 - acc: 0.8761
11136/15998 [===================>..........] - ETA: 2s - loss: 0.3690 - acc: 0.8763
11264/15998 [====================>.........] - ETA: 2s - loss: 0.3691 - acc: 0.8763
11392/15998 [====================>.........] - ETA: 2s - loss: 0.3711 - acc: 0.8756
11520/15998 [====================>.........] - ETA: 2s - loss: 0.3707 - acc: 0.8757
11648/15998 [====================>.........] - ETA: 2s - loss: 0.3700 - acc: 0.8759
11776/15998 [=====================>........] - ETA: 2s - loss: 0.3689 - acc: 0.8761
11904/15998 [=====================>........] - ETA: 2s - loss: 0.3682 - acc: 0.8763
12032/15998 [=====================>........] - ETA: 2s - loss: 0.3686 - acc: 0.8762
12160/15998 [=====================>........] - ETA: 1s - loss: 0.3698 - acc: 0.8757
12288/15998 [======================>.......] - ETA: 1s - loss: 0.3723 - acc: 0.8751
12416/15998 [======================>.......] - ETA: 1s - loss: 0.3727 - acc: 0.8749
12544/15998 [======================>.......] - ETA: 1s - loss: 0.3737 - acc: 0.8743
12672/15998 [======================>.......] - ETA: 1s - loss: 0.3742 - acc: 0.8741
12800/15998 [=======================>......] - ETA: 1s - loss: 0.3736 - acc: 0.8741
12928/15998 [=======================>......] - ETA: 1s - loss: 0.3739 - acc: 0.8743
13056/15998 [=======================>......] - ETA: 1s - loss: 0.3729 - acc: 0.8748
13184/15998 [=======================>......] - ETA: 1s - loss: 0.3724 - acc: 0.8752
13312/15998 [=======================>......] - ETA: 1s - loss: 0.3714 - acc: 0.8755
13440/15998 [========================>.....] - ETA: 1s - loss: 0.3705 - acc: 0.8759
13568/15998 [========================>.....] - ETA: 1s - loss: 0.3692 - acc: 0.8762
13696/15998 [========================>.....] - ETA: 1s - loss: 0.3692 - acc: 0.8762
13824/15998 [========================>.....] - ETA: 1s - loss: 0.3721 - acc: 0.8753
13952/15998 [=========================>....] - ETA: 1s - loss: 0.3802 - acc: 0.8736
14080/15998 [=========================>....] - ETA: 0s - loss: 0.3840 - acc: 0.8724
14208/15998 [=========================>....] - ETA: 0s - loss: 0.3837 - acc: 0.8723
14336/15998 [=========================>....] - ETA: 0s - loss: 0.3845 - acc: 0.8719
14464/15998 [==========================>...] - ETA: 0s - loss: 0.3843 - acc: 0.8720
14592/15998 [==========================>...] - ETA: 0s - loss: 0.3836 - acc: 0.8720
14720/15998 [==========================>...] - ETA: 0s - loss: 0.3827 - acc: 0.8724
14848/15998 [==========================>...] - ETA: 0s - loss: 0.3819 - acc: 0.8726
14976/15998 [===========================>..] - ETA: 0s - loss: 0.3816 - acc: 0.8725
15104/15998 [===========================>..] - ETA: 0s - loss: 0.3812 - acc: 0.8727
15232/15998 [===========================>..] - ETA: 0s - loss: 0.3807 - acc: 0.8729
15360/15998 [===========================>..] - ETA: 0s - loss: 0.3796 - acc: 0.8734
15488/15998 [============================>.] - ETA: 0s - loss: 0.3793 - acc: 0.8731
15616/15998 [============================>.] - ETA: 0s - loss: 0.3800 - acc: 0.8730
15744/15998 [============================>.] - ETA: 0s - loss: 0.3799 - acc: 0.8729
15872/15998 [============================>.] - ETA: 0s - loss: 0.3798 - acc: 0.8727
15998/15998 [==============================] - 9s 559us/step - loss: 0.3794 - acc: 0.8730 - val_loss: 0.9004 - val_acc: 0.7364Process finished with exit code 0
详细介绍
1.下载 glove.6B.100d.txt 文件，存放在 pretrained_word_embeddings.py 文件同级目录的 glove.6B 文件夹下：
glove.6B.100d.txt （40万条记录） 中存放词和对应的向量（每个词100维）
格式：词+空格+向量（向量各元素，以空格分割）
范围：文本单词、标点符号
下图是“the”、“，”，“.”,“of”，“to”词和词向量
the -0.038194 -0.24487 0.72812 -0.39961 0.083172 0.043953 -0.39141 0.3344-0.57545 0.087459 0.28787 -0.06731 0.30906 -0.26384 -0.13231 -0.20757 0.33395 -0.33848 -0.31743 -0.48336 0.1464 -0.37304 0.34577 0.052041 0.44946 -0.46971 0.02628 -0.54155 -0.15518 -0.14107 -0.039722 0.28277 0.14393 0.23464 -0.31021 0.086173 0.20397 0.52624 0.17164 -0.082378 -0.71787 -0.41531 0.20335 -0.12763 0.41367 0.55187 0.57908 -0.33477 -0.36559 -0.54857 -0.062892 0.26584 0.30205 0.99775 -0.80481 -3.0243 0.01254 -0.36942 2.2167 0.72201 -0.24978 0.92136 0.034514 0.46745 1.1079 -0.19358 -0.074575 0.23353 -0.052062 -0.22044 0.057162 -0.15806 -0.30798 -0.41625 0.37972 0.15006 -0.53212 -0.2055 -1.2526 0.071624 0.70565 0.49744 -0.42063 0.26148 -1.538 -0.30223 -0.073438 -0.28312 0.37104 -0.25217 0.016215 -0.017099 -0.38984 0.87424 -0.72569 -0.51058 -0.52028 -0.1459 0.8278 0.27062
, -0.10767 0.11053 0.59812 -0.54361 0.67396 0.10663 0.038867 0.35481 0.06351 -0.094189 0.15786 -0.81665 0.14172 0.21939 0.58505 -0.52158 0.22783 -0.16642 -0.68228 0.3587 0.42568 0.19021 0.91963 0.57555 0.46185 0.42363 -0.095399 -0.42749 -0.16567 -0.056842 -0.29595 0.26037 -0.26606 -0.070404 -0.27662 0.15821 0.69825 0.43081 0.27952 -0.45437 -0.33801 -0.58184 0.22364 -0.5778 -0.26862 -0.20425 0.56394 -0.58524 -0.14365 -0.64218 0.0054697 -0.35248 0.16162 1.1796 -0.47674 -2.7553 -0.1321 -0.047729 1.0655 1.1034 -0.2208 0.18669 0.13177 0.15117 0.7131 -0.35215 0.91348 0.61783 0.70992 0.23955 -0.14571 -0.37859 -0.045959 -0.47368 0.2385 0.20536 -0.18996 0.32507 -1.1112 -0.36341 0.98679 -0.084776 -0.54008 0.11726 -1.0194 -0.24424 0.12771 0.013884 0.080374 -0.35414 0.34951 -0.7226 0.37549 0.4441 -0.99059 0.61214 -0.35111 -0.83155 0.45293 0.082577
. -0.33979 0.20941 0.46348 -0.64792 -0.38377 0.038034 0.17127 0.15978 0.46619 -0.019169 0.41479 -0.34349 0.26872 0.04464 0.42131 -0.41032 0.15459 0.022239 -0.64653 0.25256 0.043136 -0.19445 0.46516 0.45651 0.68588 0.091295 0.21875 -0.70351 0.16785 -0.35079 -0.12634 0.66384 -0.2582 0.036542 -0.13605 0.40253 0.14289 0.38132 -0.12283 -0.45886 -0.25282 -0.30432 -0.11215 -0.26182 -0.22482 -0.44554 0.2991 -0.85612 -0.14503 -0.49086 0.0082973 -0.17491 0.27524 1.4401 -0.21239 -2.8435 -0.27958 -0.45722 1.6386 0.78808 -0.55262 0.65 0.086426 0.39012 1.0632 -0.35379 0.48328 0.346 0.84174 0.098707 -0.24213 -0.27053 0.045287 -0.40147 0.11395 0.0062226 0.036673 0.018518 -1.0213 -0.20806 0.64072 -0.068763 -0.58635 0.33476 -1.1432 -0.1148 -0.25091 -0.45907 -0.096819 -0.17946 -0.063351 -0.67412 -0.068895 0.53604 -0.87773 0.31802 -0.39242 -0.23394 0.47298 -0.028803
of -0.1529 -0.24279 0.89837 0.16996 0.53516 0.48784 -0.58826 -0.17982 -1.3581 0.42541 0.15377 0.24215 0.13474 0.41193 0.67043 -0.56418 0.42985 -0.012183 -0.11677 0.31781 0.054177 -0.054273 0.35516 -0.30241 0.31434 -0.33846 0.71715 -0.26855 -0.15837 -0.47467 0.051581 -0.33252 0.15003 -0.1299 -0.54617 -0.37843 0.64261 0.82187 -0.080006 0.078479 -0.96976 -0.57741 0.56491 -0.39873 -0.057099 0.19743 0.065706 -0.48092 -0.20125 -0.40834 0.39456 -0.02642 -0.11838 1.012 -0.53171 -2.7474 -0.042981 -0.74849 1.7574 0.59085 0.04885 0.78267 0.38497 0.42097 0.67882 0.10337 0.6328 -0.026595 0.58647 -0.44332 0.33057 -0.12022 -0.55645 0.073611 0.20915 0.43395 -0.012761 0.089874 -1.7991 0.084808 0.77112 0.63105 -0.90685 0.60326 -1.7515 0.18596 -0.50687 -0.70203 0.66578 -0.81304 0.18712 -0.018488 -0.26757 0.727 -0.59363 -0.34839 -0.56094 -0.591 1.0039 0.20664
to -0.1897 0.050024 0.19084 -0.049184 -0.089737 0.21006 -0.54952 0.098377 -0.20135 0.34241 -0.092677 0.161 -0.13268 -0.2816 0.18737 -0.42959 0.96039 0.13972 -1.0781 0.40518 0.50539 -0.55064 0.4844 0.38044 -0.0029055 -0.34942 -0.099696 -0.78368 1.0363 -0.2314 -0.47121 0.57126 -0.21454 0.35958 -0.48319 1.0875 0.28524 0.12447 -0.039248 -0.076732 -0.76343 -0.32409 -0.5749 -1.0893 -0.41811 0.4512 0.12112 -0.51367 -0.13349 -1.1378 -0.28768 0.16774 0.55804 1.5387 0.018859 -2.9721 -0.24216 -0.92495 2.1992 0.28234 -0.3478 0.51621 -0.43387 0.36852 0.74573 0.072102 0.27931 0.92569 -0.050336 -0.85856 -0.1358 -0.92551 -0.33991 -1.0394 -0.067203 -0.21379 -0.4769 0.21377 -0.84008 0.052536 0.59298 0.29604 -0.67644 0.13916 -1.5504 -0.20765 0.7222 0.52056 -0.076221 -0.15194 -0.13134 0.058617 -0.31869 -0.61419 -0.62393 -0.41548 -0.038175 -0.39804 0.47647 -0.15983
20_newsgroup 文件夹中内容（20种新闻类别）
20_newsgroup 每个子文件中有1000个文件，例如alt.atheism文件夹中文件列表
alt.atheism文件夹中49960文件中内容如下：
embedding_layer = Embedding(num_words,EMBEDDING_DIM, # EMBEDDING_DIM = 100 weights=[embedding_matrix],input_length=MAX_SEQUENCE_LENGTH, # MAX_SEQUENCE_LENGTH = 1000 trainable=False)
1.首先构建一个单词和降维编码（已经不是one-hot编码（维度太高），100维数据，已经降维）的对应关系表
表 单词和降维编码举例（假设该词汇表有20000个词，）
| 编号 | 词 | 索引 | one-hot编码 | 降维编码 |
| 1 | the | 1 | 1 0. . . 0 (1后面19999个0，维度太高，需要降维) | 0.256 0.311 ... 0.123 (100维) |
| 2 | to | 2 | 0 1 . . . 0 (1后面19998个0，维度太高，需要降维) | 0.152 0.201 ... 0.423 (100维) |
2.构建一个输入句子的矩阵
如果句子是1000个单词，每个单词100维度（怎么来，见1降维编码）
| 编号 | 词（句子的词按顺序为矩阵的一行） | 索引 | 降维编码（用一组数字表示，每组1000个数字） | |
| 1 | the | 1 | 0.256 0.311 ... 0.123 (100维) | |
| 2 | to | 2 | 0.152 0.201 ... 0.423 (100维) |
依次类推，构成一个1000（句子单词数）x100（每个单词的降维编码）的（句子）特征矩阵。
可以理解为一张单通道的图，后续的卷积操作类似在一张图处理，结果是获取图片的分类。
Embedding的作用，转换一个文本句子为容易（神经网络）处理的一个数据（样本，矩阵是该样本的数据表现形式）。
建议阅读
Embedding
本分类中的降维方法总结
word2vec－词向量embeding实现
【word2vec】Distributed Representation——词向量
不懂word2vec，还敢说自己是做NLP？
Keras详细介绍
英文：https://keras.io/
中文：http://keras-cn.readthedocs.io/en/latest/
实例下载
https://github.com/keras-team/keras
https://github.com/keras-team/keras/tree/master/examples
完整项目下载
方便没积分童鞋，请加企鹅452205574，共享文件夹。
包括：代码、数据集合（图片）、已生成model、安装库文件等。
官网实例详解4.37（pretrained_word_embeddings.py）-keras学习笔记四相关推荐
- 官网实例详解-目录和实例简介-keras学习笔记四
https://github.com/keras-team/keras/tree/master/examples Keras examples directory Keras实例目录 (点击跳转) 官 ...
- 第10课：底实战详解使用Java开发Spark程序学习笔记
第10课:底实战详解使用Java开发Spark程序学习笔记 本期内容: 1. 为什么要使用Java? 2. 使用Java开发Spark实战 3. 使用Java开发Spark的Local和Cluster ...
- php聊天室禁止提交,phpcms v9禁止提交信息到官网方法详解
phpcmsv9后台登陆时,会向官网http://update.v9.phpcms.cn联网,说是检查更新,实际同时也收集网站以及管理员的用户信息还有登陆者的设备等信息.开始以为去掉后台模板中的相关网 ...
- active什么牌子_maiaactive 玛娅是什么牌子,创始人,官网,怎么样详解
导读:本文归纳了 maia active是什么牌子,创始人,官网,怎么样, 有没有实体店,联系方式等的一些详细介绍供给大家参考. MAIA ACTIVE It's good to be me 一个强 ...
- CentOS ios镜像官网下载详解(CenOS-7-x86_64-DVD-1804版)
本文主要教新手小白怎么一步步下载到自己想要的旧版本镜像. 官网地址centos !点击下载在这里插入图片描述 下载的首页都是最新版 或者相近的版本 出于安全考虑 还是建议大家自己在官网下载
- ASP.NET Core分布式项目实战（详解oauth2授权码流程）--学习笔记
最近公司产品上线,通宵加班了一个月,一直没有更新,今天开始恢复,每日一更,冲冲冲 任务13:详解oauth2授权码流程 我们即将开发的产品有一个用户 API,一个项目服务 API,每个服务都需要认证授 ...
- 第10课：底实战详解使用Java开发Spark程序学习笔记（二）
Maven下的Spark配置: http://maven.outofmemory.cn/org.apache.spark,这个网站提供了Spark core.Spark Streaming使用Mave ...
- shiro详解-shiro史上最全学习笔记
1.shiro简介 1.1.基本功能点 Shiro 可以非常容易的开发出足够好的应用,其不仅可以用在 JavaSE 环境,也可以用在 JavaEE 环境.Shiro 可以帮助我们完成:认证.授权.加密 ...
- 微信小程序 获取用户信息 官网例程 详解
//index.js //index.js //获取应用实例 const app = getApp()Page({data: {motto: 'diligent is the short cut',/ ...
最新文章
- java acm 统计元音_hdu 2027 统计元音 （java）
- 从oracle中读取图片,从oracle数据库中读取图片，在jsp?
- 正面交锋！另类“竞赛”探索大脑的意识起源
- C++中static关键字用法
- PHP读取数据库表显示到前台
- [蓝桥杯][算法提高VIP]开灯游戏-dfs
- [TJOI2018]智力竞赛 （匈牙利）
- python应用体系_python-大型django应用程序体系结构
- erlang的dict源码解析（1）
- Java poi设置打开模式_java操作Excel的poi 格式设置
- 下 文库 试读_数字资源专题导览 | 科学文库简介
- React Native – 使用 JavaScript 开发原生应用
- jQuery学习之DOM操作
- 基于MHSS的ARAIM算法的详细分析解释
- 单闭环直流调速系统仿真实验
- 自定义dns服务器是什么,dns服务器有什么用（电脑设置DNS的方法）
- React爬坑之路二：Router+Redux
- amd为什么还用针脚_为什么AMD的CPU不采用LGA封装技术？还在继续用针脚？
- UBOOT----基于itop4412开发板，从0开始，慢慢摸索UBOOT的启动流程和系统组织结构（一）
- 【论文精读】Deep Rectangling for Image Stitching: A Learning Baseline