Questions tagged [tensorflow]

A Python library for deep learning developed by Google. Use this tag for any on-topic question that (a) involves tensorflow either as a critical part of the question or expected answer, & (b) is not just about how to use tensorflow.

Filter by
Sorted by
Tagged with
0
votes
1answer
20 views

Finding patterns in binary files using deep learning

I am a newbie in deep learning and wanted to know if the problem I have at hand is a suitable fit for deep learning algorithms. I have thousands of fragments each of about 1000 bytes size (i.e. ...
0
votes
2answers
54 views

Manipulate keras multiple loss

Lets assume that we have a model model_A and we want to build up a backpropagation based on 3 different loss functions. The first loss (...
1
vote
0answers
10 views

Is Determinism important for Hyperparameter Tuning?

When training the Model on GPU, different results are retrieved for the same hyperparameters. This effect can be shut down by using CPU or Tensorflow 2.1. with deterministic settings. The Post on ...
1
vote
0answers
6 views

How to build a sentence classifier with tensorflow, that has two sub bi-lstms one for sentence embedding and other for sentence classification?

I want to build a model that takes a document, creates sentence embedding for each sentence using a bi-LSTM, then use the sequence of sentences embedding as input to another bi-LSTM that outputs a ...
0
votes
0answers
24 views

How do I apply Min Max scaling for numerical forecast when both dependent and independent volumes are increasing over time?

I'm want to build a numerical regression to forecast. From my initial analysis, it shows linear models (glm) out performs the typical decision tree models (xgboost, ranger...etc). I hypothesized that ...
1
vote
1answer
43 views

Masked Autoencoder MADE implementation in TensorFlow vs Pytorch

I am following the course CS294-158 [1] and got stuck with the first exercise that requests to implement the MADE paper (see here [2]). My implementation in TensorFlow [3] achieves results that are ...
1
vote
0answers
24 views

Keras Neural Network: use loss from one output in the loss of the other output [closed]

I would like to use the loss from one of my NN auxiliary outputs as part of the loss for the other output. $L($total$) = L($main output$) - \lambda L($auxiliary output$)$ I am unsure how to access ...
0
votes
0answers
6 views

Where the embeddings should be implemented in the RNN model?

Hi All (it's my first question here so welcome everyone), I wrote simple RNN model in tensor flow and I cannot figure out where the embeddings should be inserted inside, please find my code and below ...
0
votes
1answer
26 views

Building a neural network with two training paths in Keras

I am trying to build a NN in Keras with two different output paths where the first path informs the second. The first path passes its loss to the end of the second path, like so: Pass through layer A ...
0
votes
0answers
26 views

3D image segmentation: 2D slice-wise vs full 3D model?

I need to segment a volume of $N\times N \times N$ pixels. I can do it in two ways, using a fully 3D convolutional neural network (e.g.: Conv3D in Keras), or I can segment $N$ 2D slices (e.g. Conv2D) ...
2
votes
1answer
21 views

Which is the error of a value corresponding to the maximum of a function?

This is my problem: I use data observed with MUSE (which is an astronomical instrument provides cubes, i.e. an image for each wavelength with a certain range, link ) to extract a measure of redshift. ...
0
votes
0answers
12 views

Handling missing target values in vector regression problem with Keras

I'm doing a vector regression problem and many of the target vectors have a few components which are missing (so these components are recorded as nans in the ...
0
votes
0answers
12 views

Why would we use different output and recurrent activations in an LSTM? [duplicate]

I am developing a LSTM network with Tensorflow. The Tensorflow LSTM documentation shows that there are different activations for the output of the timestep (tanh) and for the data flowing back in to ...
2
votes
0answers
41 views

Interpretation of Tensor Flow CNN results with big dips in accuracy while training

I am trying to classify images using a CNN in tensor flow. I am doing 10 fold cross validation. At each fold, the training set is 900+ images and the validation set is 100 images. It is only two ...
0
votes
0answers
20 views

Use transfer learning with subclassing api of tensorflow keras

I am able to use transfer learning with sequential and functional api but I want to use ResNet50 from tf.keras.applications with subclassing model api of tf.keras. Is this possible? If yes, Can anyone ...
0
votes
0answers
7 views

One step prediction of time series using LSTM

I want to predict stock prices using LSTM. I have successfully trained my model and have it saved. Now that I've loaded it back in, how would I use model.predict() ...
1
vote
0answers
46 views

WGAN-GP stability loss

I am training a Conditional WaveGAN (1D DCGAN for audio) using WGAN-GP whose generator is of an auotencoder architecture. The network is trained to take an audio input, compress it, then decompress it ...
0
votes
0answers
20 views

Gradient Boosting and neural networks

Is there any Python package that implements a boosted neural network ? Any pointer is appreciated. A sample reference about the boosting and NN can be this one.
1
vote
1answer
33 views

Low memory time series input for deep learning

Background I have some data that looks like this: ...
1
vote
2answers
53 views

Should I normalize all data prior feeding the tensorflow models?

Appreciate your wisdom on this, My understanding is most of the tutorials recommend normalizing / scaling the data prior feeding the tensorflow models. Doesn't normalization require that data ...
0
votes
0answers
20 views

Autodiff implementation for policy gradient methods (reinforcement learning)

Maybe this is better posted on stackoverflow, but I thought I would start here . I am trying to understand how RL policy gradient style algorithms are implemented in autodiff frameworks like ...
0
votes
0answers
34 views

tensorflow high validation acuraccy but bad predictions

I asked this over at stackoverflow but this seems to be the specific place to ask machine learning questions so hopefully I can get more answers. Anyways I am trying to make a multiclassed multilabel ...
0
votes
0answers
21 views

Keras model with Google BERT -> very low accuracy [duplicate]

I'm attempting to fine-tune Google BERT to be able to classify some text to a single integer label (multiclass classification). I have the model up and running, however the predicted labels are all ...
0
votes
1answer
90 views

Difference between batch_size=1 and SGD optimisers in Keras

I have a question that to implement stochastic gradient descent we set the batch size=1 what ever be the optimizer.So what does sgd optimizer do that is different then setting batch size=1 using any ...
0
votes
0answers
10 views

LSTM for non-timeseries data - Input Shape

I am dealing with a non-time series problem. I have a total of 20 features. 19 for input and 1 for output I have my input as follows: ...
0
votes
0answers
13 views

Regression with CNN Loss won't pass certain values

I'm working on a regression problem which since my dataset is images i prefered to use widely used CNNs.In general,i have to predict a single value between 0 and 500 for a 100x100 grid based on the ...
0
votes
1answer
27 views

Tensorflow how to make a training data

I'm a begginer in programming I beg your pardon for that question, I just want to learn. The function tf.keras.datasets.mnist.load_data() returns ...
0
votes
0answers
17 views

Tacking out of vocab words in neural machine translation with fasttext

I am trying to tackle out of vocab words in my machine translation model build using Tensorflow's official implementation of NMT . I am very much confused how to do it since I am new to NLP. I tried ...
0
votes
0answers
47 views

CNN Mask - IoU Versus Keras “Accuracy”

I am using Keras/Tensorflow to do an FPN CNN model for basic binary mask detection, and have the trainer set to track the metrics of 'IoU' and and the built-in default Keras 'accuracy' metric. IoU is ...
0
votes
0answers
31 views

Is tensorflow LKJ distribution correct?

I am trying to verify that this distribution is propoprtional to a power of the determinant of the matrix: https://www.tensorflow.org/probability/api_docs/python/tfp/distributions/CholeskyLKJ Which ...
1
vote
1answer
16 views

Why does padding affect my results?

I'm learning deep learning, and have been looking at a tutorial for autoencoders using MNIST. It's quite straightforward, and I think I understand it quite well so far. This is the code from the ...
0
votes
0answers
7 views

How to train model with custom train/test split ratio?

what i mean train/split ratio is that i've very few images to train model on so is it possible to allocate 100% images to train split and ignore test split entirely? link to project here https://...
0
votes
0answers
13 views

Predictions all coming out the same

Sorry for this basic question, I'm a total noob. I have input data in the format of 6000 x 3 x 256, that is 6000 rows with 3 features, which themselves contain 256 ...
1
vote
1answer
24 views

What is the actual use of GAN model? Is it only used to generate the data that closely resembles original dataset?

I am very new to tensor flow. I came across GANS. From what I understand in GANs there are 2 models, Generator and Discriminator. Generator job is to generate the data that will be able to fool the ...
0
votes
0answers
8 views

Weird validation model loss with a stable accuracy

I've trained a CNN based model for activity recognition. The model's validation loss is spiking as seen in the image below What is strange is that the accuracy of my model's validation remains ...
0
votes
1answer
15 views

Slower training after transfer learning

Before I used a model to categorize cars, bikes and bicycles that looked like this: ...
0
votes
0answers
69 views

Reconstruction Loss in Keras with custom loss function

Using Tensorflow 2: My model has an input RGB image of shape (64, 64, 3) and outputs a RGB image of the same shape. I want to use a custom reconstruction loss, therefore I write my loss function to ...
2
votes
1answer
125 views

Loss reduction: when to use sum and when mean? [duplicate]

In the PyTorch documentation for most losses, there is a parameter called reduction usually, and it is mean, but there is also a ...
0
votes
0answers
17 views

Over fitting RNN model

I have written a GRU model in order to predict power output. I have noticed though that after 5-6 epochs my val_loss starts to increase and doesn't stop after each epoch and it overfits pretty bad. I ...
0
votes
0answers
10 views

Normalize new inputs

So far in my data I only have percentages (0-1) values, but I want to introduce a new feature with different values. I know, I should use normalization (min-max) Let's say I have [23, 54, 0, 79, 100] ...
1
vote
1answer
30 views

Why does the 1D convolution use 3 params when the filter is 2

I call the Keras Conv1D function ...
0
votes
0answers
23 views

How to train LSTM model with multiple time series?

Hello I'm trying to predic the ETA(estimated arrival time) of airplanes, for that propouse I have data from 996 planes, and all messages collected from ADS-B recivers. Each plane has diferent time ...
0
votes
0answers
37 views

weight visualization of 3d convolutional kernel

I am using 3d kernel of size 3x3x3 for the convolution layer and would like to plot the weights of the layer. Since plotting in 3d is not possible I tried to split the kernels into 3 3×3 for plotting....
0
votes
0answers
36 views

Understanding the result of Maximum Likelihood calculation in OpenAI exersice1-1

This is a TensorFlow code to calculate Maximum log-likelihood from this link. ...
0
votes
1answer
32 views

Are RNNs in Keras dynamic length?

Sorry if this seems like a basic question. From my understanding, one of the advantages of sequence models like RNNs is that they can handle variable length input sequences. For example, if I'm ...
0
votes
0answers
13 views

RNN does not learn simple time series [duplicate]

I can't get a RNN to learn a simple linear sequence, broken into 90 batches of 10 steps each I would expect that it should totally overfit the training sequence. Instead, it does not learn (high loss)...
0
votes
0answers
4 views

Relation of TBPTT and Saving States

I was wondering if someone could check whether my understanding of Truncated Backpropagation Through Time (TBPTT) is correct, maybe even with particular focus on Tensorflow. Let us assume I have very ...
0
votes
1answer
73 views

Regression for noisy data with tensorflow: low train and validation errors but high test error

I have a training set of 6400 samples. Each sample is composed of an input of size 100, which is essentially a noise process. The input of the first sample is: The output is the solution of a ...
0
votes
0answers
66 views

How concatenate data to the output of a layer in Keras?

I currently have a simple autoencoder with a 1 layer encoder and 1 layer decoder. Instead of this structure, I want to concatenate a vector of values to the latent space before being passed into the ...
0
votes
0answers
110 views

Which ML algorithm, architecture and packages could be used for 3D sequence data with 4D-5D output?

I want to train a model on FEM simulations and predict the deformations and the stresses. So, the input is the geometry (~100k nodes with x, y, z dimensions) and the "master node", where the strain ...

1
2
3 4 5
12