Choosing the adequate layout convention for matrix derivatives











up vote
1
down vote

favorite












Is there a rule (or maybe a rule of thumb) that provides guidance for choosing the layout convention (see Layout conventions, wiki) to use when dealing with matrix derivatives?



I found a hint in this answer here to a related question but I could hardly find any well justified answer.










share|cite|improve this question






















  • Try working a few problems in each. Then pick the one you like best and stick with it. And if you read an article using the other convention, it isn't difficult to translate it to your preferred convention.
    – greg
    Nov 29 at 21:21










  • @greg That's what I've been doing. But, I believe the layouts are not equivalently meaningful. Of course, any layout would give the derivatives but the arrangement seems important. This is explained in a section of Magnus and Neudecker's "Matrix Differential Calculus" (under First-order differentials and Jacobian matrices) that talks about why some notation (layout) is bad. The authors also give what they consider good notation and why.
    – Likely
    Dec 1 at 4:02










  • Magnus and Neudecker make some good points. I would suggest that you read "Complex-Valued Matrix Derivatives" by Are Hjorungnes for another point of view.
    – greg
    Dec 1 at 4:11










  • @greg Okay, thank you for the reference.
    – Likely
    Dec 2 at 22:02















up vote
1
down vote

favorite












Is there a rule (or maybe a rule of thumb) that provides guidance for choosing the layout convention (see Layout conventions, wiki) to use when dealing with matrix derivatives?



I found a hint in this answer here to a related question but I could hardly find any well justified answer.










share|cite|improve this question






















  • Try working a few problems in each. Then pick the one you like best and stick with it. And if you read an article using the other convention, it isn't difficult to translate it to your preferred convention.
    – greg
    Nov 29 at 21:21










  • @greg That's what I've been doing. But, I believe the layouts are not equivalently meaningful. Of course, any layout would give the derivatives but the arrangement seems important. This is explained in a section of Magnus and Neudecker's "Matrix Differential Calculus" (under First-order differentials and Jacobian matrices) that talks about why some notation (layout) is bad. The authors also give what they consider good notation and why.
    – Likely
    Dec 1 at 4:02










  • Magnus and Neudecker make some good points. I would suggest that you read "Complex-Valued Matrix Derivatives" by Are Hjorungnes for another point of view.
    – greg
    Dec 1 at 4:11










  • @greg Okay, thank you for the reference.
    – Likely
    Dec 2 at 22:02













up vote
1
down vote

favorite









up vote
1
down vote

favorite











Is there a rule (or maybe a rule of thumb) that provides guidance for choosing the layout convention (see Layout conventions, wiki) to use when dealing with matrix derivatives?



I found a hint in this answer here to a related question but I could hardly find any well justified answer.










share|cite|improve this question













Is there a rule (or maybe a rule of thumb) that provides guidance for choosing the layout convention (see Layout conventions, wiki) to use when dealing with matrix derivatives?



I found a hint in this answer here to a related question but I could hardly find any well justified answer.







linear-algebra derivatives matrix-calculus






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked Nov 28 at 1:17









Likely

84




84












  • Try working a few problems in each. Then pick the one you like best and stick with it. And if you read an article using the other convention, it isn't difficult to translate it to your preferred convention.
    – greg
    Nov 29 at 21:21










  • @greg That's what I've been doing. But, I believe the layouts are not equivalently meaningful. Of course, any layout would give the derivatives but the arrangement seems important. This is explained in a section of Magnus and Neudecker's "Matrix Differential Calculus" (under First-order differentials and Jacobian matrices) that talks about why some notation (layout) is bad. The authors also give what they consider good notation and why.
    – Likely
    Dec 1 at 4:02










  • Magnus and Neudecker make some good points. I would suggest that you read "Complex-Valued Matrix Derivatives" by Are Hjorungnes for another point of view.
    – greg
    Dec 1 at 4:11










  • @greg Okay, thank you for the reference.
    – Likely
    Dec 2 at 22:02


















  • Try working a few problems in each. Then pick the one you like best and stick with it. And if you read an article using the other convention, it isn't difficult to translate it to your preferred convention.
    – greg
    Nov 29 at 21:21










  • @greg That's what I've been doing. But, I believe the layouts are not equivalently meaningful. Of course, any layout would give the derivatives but the arrangement seems important. This is explained in a section of Magnus and Neudecker's "Matrix Differential Calculus" (under First-order differentials and Jacobian matrices) that talks about why some notation (layout) is bad. The authors also give what they consider good notation and why.
    – Likely
    Dec 1 at 4:02










  • Magnus and Neudecker make some good points. I would suggest that you read "Complex-Valued Matrix Derivatives" by Are Hjorungnes for another point of view.
    – greg
    Dec 1 at 4:11










  • @greg Okay, thank you for the reference.
    – Likely
    Dec 2 at 22:02
















Try working a few problems in each. Then pick the one you like best and stick with it. And if you read an article using the other convention, it isn't difficult to translate it to your preferred convention.
– greg
Nov 29 at 21:21




Try working a few problems in each. Then pick the one you like best and stick with it. And if you read an article using the other convention, it isn't difficult to translate it to your preferred convention.
– greg
Nov 29 at 21:21












@greg That's what I've been doing. But, I believe the layouts are not equivalently meaningful. Of course, any layout would give the derivatives but the arrangement seems important. This is explained in a section of Magnus and Neudecker's "Matrix Differential Calculus" (under First-order differentials and Jacobian matrices) that talks about why some notation (layout) is bad. The authors also give what they consider good notation and why.
– Likely
Dec 1 at 4:02




@greg That's what I've been doing. But, I believe the layouts are not equivalently meaningful. Of course, any layout would give the derivatives but the arrangement seems important. This is explained in a section of Magnus and Neudecker's "Matrix Differential Calculus" (under First-order differentials and Jacobian matrices) that talks about why some notation (layout) is bad. The authors also give what they consider good notation and why.
– Likely
Dec 1 at 4:02












Magnus and Neudecker make some good points. I would suggest that you read "Complex-Valued Matrix Derivatives" by Are Hjorungnes for another point of view.
– greg
Dec 1 at 4:11




Magnus and Neudecker make some good points. I would suggest that you read "Complex-Valued Matrix Derivatives" by Are Hjorungnes for another point of view.
– greg
Dec 1 at 4:11












@greg Okay, thank you for the reference.
– Likely
Dec 2 at 22:02




@greg Okay, thank you for the reference.
– Likely
Dec 2 at 22:02















active

oldest

votes











Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3016572%2fchoosing-the-adequate-layout-convention-for-matrix-derivatives%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown






























active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes
















draft saved

draft discarded




















































Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3016572%2fchoosing-the-adequate-layout-convention-for-matrix-derivatives%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Berounka

Sphinx de Gizeh

Different font size/position of beamer's navigation symbols template's content depending on regular/plain...