Questions tagged [convolution]
For use when discussing the commutative and linear, but not associative operator interpreted on functions and distributions.
285 questions
2 votes
0 answers
39 views
Convolution Kernels - Understanding dilation
I have a fairly good understanding of the basic convolution operation and how padding & stride affect its output, but dilation is something new to me. So I am going to make some broad statements ...
3 votes
1 answer
55 views
Is there a more efficient implementation of kernel-based filtering?
I have implemented a simple version of the kernel-based convolution operation as shown below. However, for faster code operation, I think the nested for loop is slowing up the operation. Is there any ...
0 votes
0 answers
38 views
Deconvolution, NN-resize convolution
I was reading following paper: Deconvolution and Checkerboard Artifacts. The text says that Both deconvolution and the different resize-convolution approaches are linear operations, and can be ...
0 votes
0 answers
31 views
Are group convolutions still used?
Group convolutions theoretically should reduce the number of parameters and hence improve the speed of inference, without significantly affecting the performance of the model. However, I don't notice ...
0 votes
1 answer
154 views
Conv2d with time series
I have a question about how a CONV2D layer handles time series data. How with filters that scroll through time, our model can extract features and capture and model our target value? Thank you in ...
1 vote
1 answer
86 views
Output of a convolutional layer
Is the calculated output correct?
1 vote
1 answer
53 views
What are the general rules or principles for finding matrix operations that are used as filters in convolutional neural networks?
Is there a set of rules or guidelines for designing filters for convolutional neural networks? For example, a 3 x 3 layer with ones in the first column, zeroes in the second, and negative ones in the ...
0 votes
1 answer
393 views
Shape of Flattened Layer in CNN
If I have a convolutional layer with dimension (5,5,4), (i.e, 4 no. of 5x5x1 feature maps), what will be the dimension of the flattened layer, if I apply flattening ...
0 votes
1 answer
165 views
What neural network architecture would help me model a spectrogram?
I'm really a novice working with these technologies and I'm struggling to design a neural network that is powerful enough to model a spectrogram. For a personal project, I'm working on a spectrogram ...
1 vote
1 answer
98 views
How to align the description of a convolutional neural network in keras with wikipedia's conceptual model?
I was going through the introductory guide to convolutional neural networks in tensor flow here And I was trying to logically map some of the code I saw to my actual understanding of how convolutional ...
1 vote
1 answer
229 views
Multi-channel convolution in Tensorflow
Suppose I have a sequence data of size $B \times N \times d$ where $B$ is the batch size, $N$ is the sequence length, and $d$ is the dimension or the number of features. Suppose I want to do 1D ...
1 vote
1 answer
2k views
Transpose Convolution Output Size
I have been learning GAN (Generative Adversarial Networks) lately and having a hard time understanding the output size for transpose convolution. Let's say I am using a Tensor of [1, 64, 1, 1] as an ...
0 votes
1 answer
1k views
CNN model why is ReLu used in Conv1D layer and in the first Dense Layer?
I have a problem. I have a CNN model which is used for an NLP problem. This is written in Python. I have questions about this, which I can't find an answer to. Why is ReLu used inside the Conv1D ...
1 vote
1 answer
81 views
Transpose Convolution feature extraction
Convolution extracts high-level features, but what about Transpose Convolution (or De/Up-Convolution)? Does it behave exactly the opposite? Does it generate lower-level features?
2 votes
0 answers
32 views
why layer of dimension 1 is outputting image of size n
I am studying a model where landmarks from an image are calculated. The work comes from Convolutional Experts Constrained Local Model for 3D Facial Landmark Detection. I need to confirm why the ...