Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about DyLinear block #7

Open
khchul opened this issue Mar 27, 2024 · 2 comments
Open

Question about DyLinear block #7

khchul opened this issue Mar 27, 2024 · 2 comments

Comments

@khchul
Copy link

khchul commented Mar 27, 2024

Thanks for the great work!
I've read your paper and got confused in DyLinear blocks and ask here to get some clarifications.

Q, Is DyLinear block applied to each variables independently? In equation (2), I believe that $z_s$ is sized $l_s$ * v * d and WInterp is sized $w_i * w_o$. How are WInterp$z_s$ calculated and what is exactly lout ? Also if it is calculated as independent, why do we need interpolation? Isn't d fixed among different time series?

Thank you

@gasvn
Copy link
Member

gasvn commented Apr 1, 2024

Yes, DyLinear block applied to each variables independently. Dylinear is used to change to weight shape to make it match various sequence lengths.

@khchul
Copy link
Author

khchul commented Apr 3, 2024

Thank you for your clarification!
Though I still can't follow the purpose of DyLinear block.
I first thought it was added to force the variable sized sequences to have fixed length, but realized this cannot be done due to the division of Zin (since Z2mid doesn't pass DyLinear operator).

Could you elaborate more of the effect of DyLinear block?
Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants