Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [artificial-intelligence]

Artificial Intelligence (AI) is a topic in computer science that deals with the study / creation of intelligent machines. Use this tag for on-topic questions that have an AI aspect.

0
votes
0answers
7 views

Reinforcement learning with two goal states [closed]

I implemented my first TD off-policy method for discrete states and discrete actions (increase or decrease to last executed action) on a patient in real time. Now I am extending my problem from one ...
1
vote
0answers
17 views

How to handle missing data in PPCA

I am implementing a paper "Probabilistic Principal Component Analysis" (PPCA) which deals with a dataset where each vector suffers from at least one missing value missing values. Generally, PPCA ...
0
votes
1answer
35 views

How to apply multi agent deep reinforcement learning to an environment with discrete action space

Do you know or have heard about any cutting edge deep reinforcement-learning algorithm which can be successfully applied for discrete action-spaces in multi-agent settings? I have been researching ...
1
vote
0answers
49 views

Proof of NOT initialization of weights to zero

Can anyone provide me the mathematical details to why we shouldn't initialize a neural network (single layer ANN) weights to zero? In multi-layer we don't initialize it to zero because of loss of ...
1
vote
0answers
27 views

What is the difference between Generative Adversarial Networks (GAN) and Generative Antagonistic System (GAS)?

What is the difference between Generative Adversarial Networks (GAN) and Generative Antagonistic System (GAS) in the neural network?
0
votes
0answers
17 views

Variance of error term is nonconstant between observations

I used XGB algorithm to train a model. The task is to train models to predict human personality based on his/her personal photo. We found some significant features when we extracted them by Pearson ...
1
vote
1answer
39 views

Trouble understanding value iteration

I have trouble understanding how the value iteration algorithm for MDP:s work. I'm trying to follow the canonical grid world example (slide 17), but I don't get the correct results. Here's my work: ...
0
votes
1answer
56 views

Mobilenet Original Paper Architecture vs Keras Implementation

1. Question: Why do original paper mobilenet architecture and keras implementation differ? Keras implementation of mobilenet's last 5 layers after AVG Pool layer: ...
2
votes
1answer
96 views

What is intuition behind high variance of Monte Carlo method? [closed]

I'm studying Reinforcement learning from lectures of David silver, where he says that Monte Carlo method is not biased and has very high variance. But I don't understand in which sense the bias and ...
0
votes
1answer
44 views

How to train neural network to say whether a given input belongs to the samples we have in dataset or not? [closed]

Suppose I have n samples with m features and a binary output (say 0 or 1). How do I create a neural network model which says whether a given input(to be predicted sample) is present in the samples(...
1
vote
0answers
34 views

Artificial Intelligence to Navigate websites [closed]

I have a requirement to create a bot that could Login to a website with credentials and then extract specific information from the website. Also the bot should be capable of doing the same on ...
0
votes
1answer
52 views

How to select activation functions for neural networks?

What is the process of selecting the best activation function? I already know which functions are better for which kind of problem, but I don't know why a particular function is better for a ...
0
votes
0answers
176 views

Epsilon Greedy Performing better than UCB

I am implementing the bandit problem using various algorithms. The issue that i am facing is that epsilon greedy is performing better than UCB for 5arms and horizon of 2000 for epsilon value of 0.95. ...
3
votes
1answer
62 views

What is an “undirected associative memory” in Hinton et al 2006?

In A fast learning algorithm for deep belief nets, the authors use the term "undirected associative memory". I am not sure what they are referring to, and unfortunately Google searches for this term ...
0
votes
0answers
14 views

Data transformation for ANN models

I'm trying to predict the customer churn using company's user care center data. The initial table looks like this: ...
0
votes
2answers
36 views

Neural network trained with potentially incomplete data set

Please forgive my ignorance. I'm new to deep learning and this could prove to be a "stupid" question... I want to build a neural network that can predict some outcome "x". I have training data that ...
0
votes
0answers
16 views

Evaluation of a model in adaptive learning

I'm implementing an artificial intelligence for an adaptive learning software. We propose exercises to learn how to read. We have a first model that predicts the success or failure of students on the ...
0
votes
1answer
35 views

Big categorical data

I am trying to predict the price of used vehicles using three different models: Regression, ANN, and random forest. I am having 6 variables as an input for my model. One of my variables is the ...
2
votes
0answers
50 views

When to use batch normalization in a Fully Convolutional Network

I understand what batch normalization does but I'm not sure at what point it becomes overkill. With regards to a U-net, based on just the rough definition that batch normalization normalizes the ...
0
votes
0answers
33 views

closest meaning to a given word - NLP

I am trying to build a vocabulary tutorial. The tutorial will produce automated examinations for evaluating the user. In each of those exams, I want to show a word to the user and a form is there ...
0
votes
0answers
15 views

Help with starting a feedforward neural network for wind power forecasting

I am new to Machine Learning and Python and my task is to Predict wind power based on previous wind speed data. I have implemented this before using SVR. So I understand some basics. But now I'd like ...
0
votes
1answer
23 views

n * one_hot VS n_hot encoding for modeling input layer for a card game

How should I design my input layer for the following classification problem? Input: 5 cards in a card game; vocabulary is 52 cards Output: some classification using a neural network How should I ...
0
votes
0answers
24 views

Is the following suitable for implementing using Ai and Deep Learning

I am currently working on a concept to coordinate domestic vegetation burning off, that I am not that sure really fits the bill for needing Deep Learning or AI. So I am asking this group initially ...
3
votes
1answer
21 views

Dynamic interactive learning

I am trying to solve a classification problem where I have a set of known X values. I know the classification objective i.e. the discrete set of values the Y can take. However, I don't have any ...
0
votes
1answer
109 views

machine-learning : Why training set and test set need to be independent and identically distributed?

My machine-learning book that I'm reading only says that they need to be but not why? My intuition says that if they are that leads to a better learning, if they were not it would be like we are ...
0
votes
0answers
29 views

Game problems that machine learning won't solve better than humans

Is there any type of game that could not be beaten by machine learning algorithm? Checkers and chess is not a problem for computers, go also.. But is there a class of problems in terms of let's say '...
0
votes
0answers
13 views

Using type-2-fuzzy sets and systems for automatic document summarization

I have already done a research project based on automatic document summarization using deep learning techniques. But fuzzy logic is pretty new to me, and I don't have any experience of building system ...
1
vote
0answers
28 views

Policy space optimization? Reinforcement learning

What are the reasons that you have an easier time choosing a Policy optimization algorithm when the state space is high dimensional, are there also any other reasons in the task's attributes for ...
1
vote
1answer
47 views

How can I interpret the following learning curves?

I am training a SVM with linear kernel over a training set of 3759 elements. The dimension of my problem is 2055, in other words, each example belonged to my training set is described by 2055 features....
0
votes
1answer
29 views

Create loss function thats takes probability in calculating

I am training object detection, the output is 5 numbers, probability that something is in the box , xmin, ymin, xmax , ymax What i am trying to achieve, is the "probability", to be scaled between 0 ...
3
votes
0answers
45 views

Find Feature Weighting in Deep Learning

If I train a deep neural network on standard tabular data (csv file etc. with labeled features) is there a good way to gauge how important each feature is in a particular new instance's prediction ...
1
vote
1answer
40 views

In MDPs with deterministic actions, should I use Q-learning or TD(0)?

Suppose in an Markov Decision Process (MDP), we have transition $(s, a, r, s', a', r', s'', ...)$, learning rate $\alpha$ and discount factor $\lambda$. The update formula of $TD(0)$: $V(s) \...
0
votes
0answers
9 views

CNN learns max 2 objects [duplicate]

I am working on object detector using keras and CNN. I have several datasets: usc dataset and penfundan dataset. My input is ofcourse image, and label for particular image looks like [[xmin,ymin,...
0
votes
0answers
32 views

minimal sub-graph with with a predefined cost

Given a connected weighted graph $G = (V, E, W)$, such as $w (e) >0$ , an and a positive integer $n$, How to find the minimal sub-graph $g$ (minimum number of vertices) whose sum of the weight ...
0
votes
0answers
18 views

Using machine learning to predict entities

Im curious about an approach, since i start with machine learn a few months i wonder whats the best algorthm or approach to solve that: imagine that i have a entity like this: ...
0
votes
0answers
47 views

Why more number of neurons for extreme learning machine (ELM) compared to ANN?

Why does Extreme learning machine have more number of neurons than the vanilla type of feedforwad neural networks to get the same level of generalization?
1
vote
2answers
67 views

Why this Way of iteration in RNNs? [closed]

One of the things that make them super-slow in training, is that they often use two nested loops to iterate on data through all time steps for every single iteration, calculating loss and cost at the ...
1
vote
1answer
148 views

Why can't experience replay be used for on policy methods if you re-sample new actions?

Suppose in your replay buffer you store only $(s_t, a_t, r_{t+1}, s_{t+1})$. Instead of finding the optimal Q function with this Bellman backup $Q(s_t, a_t) \leftarrow Q(s, a) + \alpha [R_{t+1} + ...
1
vote
1answer
66 views

Design of CNN whose input is a 2D game board

I am writing an artificial intelligence of a game. The algorithm needs a neural network to represent some information of the game board. The board is an 8*8 grid and each position in the grid has 4 ...
0
votes
4answers
2k views

Why is weight initialized as 1/sqrt(# of hidden nodes) in neural networks

I am currently reading Make your Own Neural Network by Tariq Rashid. He explains that instead of choosing weights randomly at a range of -1.0 to 1.0, initial weights should be in the range $ {1 \...
0
votes
1answer
33 views

Couldn't ANN's be modeled on any part of the body (not just the brain)?

It's commonly said that ANN's are modeled after the brain, but as we know, neurons are also found elsewhere in the human body. So if someone was being provocative and said that ANN's could equally ...
0
votes
0answers
170 views

Apply ML to raw sensor data for pattern matching

I'm trying to do some pattern detection experiments with smartphone motion sensors data, especially accelerometer data. First, in a recording mode, I get the sensors data associated with my pattern. ...
0
votes
0answers
54 views

Neural Network for Rain Prediction - Only Learning Averages [duplicate]

I'm attempting to create a Neural Network to use as a rain model to generate representative precipitation levels for a given location. The problem I'm facing is that the network always converges to ...
0
votes
0answers
34 views

How to choose the right structure of an artificial Neural Network? [duplicate]

Is there a generalized rule for choosing the right structure of an artificial neural network according to the model that should me modeled and simulated? Thank you!
1
vote
1answer
304 views

Why does reward function depend on expected reward of next state?

I am confused about how could we get the reward scores of next state since we have not got into next state? I thought we will get the reward for the state we are now once we reached this state?
2
votes
1answer
95 views

Is there a better term to describe “Regression”?

I have noticed that, in many posts explaining the origin of the term "Regression" (e.g. HERE), the explanations basically revolve around how the term got stuck after a biologist named Francis Galton ...
0
votes
0answers
407 views

Casino Gambling Machine Learning Application

I am working on a project with the goal of predicting the success of a casino game. One often questions why some games do much better than others -- it's not obvious in some scenarios. We have over ...
1
vote
0answers
35 views

Is reseating passengers a reinforcement learning problem?

Requirement is to optimally move passengers from one seat map to another which has a different configuration. Move should be based on many rules like - 1) Families should be sitting together 2) Those ...
1
vote
0answers
465 views

Understanding Proximal Policy Optimization

I'm a beginner in Reinforcement Learning, and have been learning about Policy Optimization methods like Proximal Policy Optimization and Trust Region Policy Optimization. I had a couple questions ...
1
vote
0answers
51 views

Quiz master agent using reinforcement learning

I am working on developing a quiz master agent using reinforcement learning. Please verify my approach and provide feedback. Also, please suggest which reinforcement learning methods are suitable to ...