Not signed in

Want to take part in these discussions? Sign in if you have an account, or apply for one below

• Username
• Password
• Remember me

• Sign in using OpenID
• Remember me

• Forgot your password?
• Apply for membership

(0 1)-category-theory 2-category 2-category-theory 2-monad abelian-categories accessible adjoint algebra algebraic algebraic-geometry analysis arithmetic beauty book bug bundle categories category category-theory chern-simons-theory cohesion cohesive-homotopy-type-theory cohomology combinatorics complex-geometry conference connection constructive constructive-mathematics cosmology database deformation-theory descent differential differential-cohomology differential-geometry duality enriched enriched-category-theory enrichment examples factorization-system fiber fibration forms foundation foundations functional-analysis functor galois-theory gauge-theory gebra general topology geometric geometric-quantization geometry gravity group-theory higher higher-algebra higher-category-theory higher-geometry higher-lie-theory higher-topos-theory history homological homological-algebra homotopy homotopy-theory homotopy-type-theory homtopy-type-theory infinity-groupoid infinity-topos integration-theory internal-categories kan lie-algebras lie-theory limit limits linear linear-algebra locale localization localization-theory logic manifolds mathematics measure measure-theory mechanics meta modal-logic model model-category-theory monoidal monoidal-category monoidal-category-theory morphism n-groups newpage noncommutative noncommutative-geometry object operator operator-algebra order-theory philosophy physics predicative pretopology pro-object probability-theory quantum quantum-field-theory quantum-mechanics quantum-physics quantum-theory question representation representation-theory riemannian-geometry set set-theory sheaf simplicial site space stable-homotopy-theory stack string string-theory subobject supergeometry symplectic-geometry tannaka tensor terminology theory topologica-quantum-field-theory topology topos topos-theory torsor tqft type type-theory universal weighted-limit

1. • CommentRowNumber1.
   • CommentAuthorTobyBartels
   • CommentTimeSep 9th 2009
   • PermaLink
   Author: TobyBartels
   Format: MarkdownLook at [[fibration sequence]] (revision 9 if necessary). See the horrible unknown characters towards the bottom? Now look at revision 8. Hey, that looks great! (at least if you have the fonts). But here's the thing: : *The code for those is exactly the same!* If you go back to when I first put that character in (revision 4), you'll see that same code. But here's the thing: : *That's not the code that I put in then!* In fact, that sort of code has never worked; you need to use an SGML numerical character entity code instead. But somehow, the migration replaced that with the actual character, even though iTeX cannot parse that! And why do the old revisions render properly, even using bad code? I have no idea!

   Look at fibration sequence (revision 9 if necessary). See the horrible unknown characters towards the bottom? Now look at revision 8. Hey, that looks great! (at least if you have the fonts). But here's the thing:

   The code for those is exactly the same!

   If you go back to when I first put that character in (revision 4), you'll see that same code. But here's the thing:

   That's not the code that I put in then!

   In fact, that sort of code has never worked; you need to use an SGML numerical character entity code instead. But somehow, the migration replaced that with the actual character, even though iTeX cannot parse that!

   And why do the old revisions render properly, even using bad code? I have no idea!

2. • CommentRowNumber2.
   • CommentAuthorAndrew Stacey
   • CommentTimeSep 9th 2009
   • PermaLink
   Author: Andrew Stacey
   Format: MarkdownI don't think that this is a migration issue. It's also not quite a character encoding issue. It seems to be to do with iTeX and unicode characters. Sticking an unusual unicode character in to iTeX causes it to complain. Why this is suddenly a problem is that the way Instiki parses entities has changed. It seems (from experimenting) that Instiki now translates SGML entities into unicode. I know that there have been some deep changes in Instiki recently and this may be due to one of them. The thing is that this happens _on input_. So when you put an entity into the code, it gets translated to a unicode character before it gets stored in the database. However, iTeX seems to have issues with certain unicode characters and changes them to 'unknown character'. That it is iTeX can be seen by the fact that `$?$` produces 'unknown character' whilst `?` is fine. The fact that this happens only with new revisions is what makes me think that it is a new change to the input parser. As old revisions are not changed, it has to be something that happens before they get stored in the database, and it has to be something that changed since these old revisions were stored. That's also why the old revisions work: they were stored in the database before the change was made and so didn't go through this particular input alteration. You as a user can only see the code for the latest revision but by going into the database then I can see that the old revisions still have the SGML entity code and it is only the newest revision that has the unicode character. I'll mention this to Jacques and put a test page on the Lab Elves web for him to look at.

   I don't think that this is a migration issue. It's also not quite a character encoding issue. It seems to be to do with iTeX and unicode characters. Sticking an unusual unicode character in to iTeX causes it to complain.

   Why this is suddenly a problem is that the way Instiki parses entities has changed. It seems (from experimenting) that Instiki now translates SGML entities into unicode. I know that there have been some deep changes in Instiki recently and this may be due to one of them. The thing is that this happens on input. So when you put an entity into the code, it gets translated to a unicode character before it gets stored in the database. However, iTeX seems to have issues with certain unicode characters and changes them to 'unknown character'. That it is iTeX can be seen by the fact that $?$ produces 'unknown character' whilst ? is fine.

   The fact that this happens only with new revisions is what makes me think that it is a new change to the input parser. As old revisions are not changed, it has to be something that happens before they get stored in the database, and it has to be something that changed since these old revisions were stored.

   That's also why the old revisions work: they were stored in the database before the change was made and so didn't go through this particular input alteration. You as a user can only see the code for the latest revision but by going into the database then I can see that the old revisions still have the SGML entity code and it is only the newest revision that has the unicode character.

   I'll mention this to Jacques and put a test page on the Lab Elves web for him to look at.

3. • CommentRowNumber3.
   • CommentAuthorAndrew Stacey
   • CommentTimeSep 9th 2009
   • PermaLink
   Author: Andrew Stacey
   Format: MarkdownJacques says that this will be fixed in the next update.

   Jacques says that this will be fixed in the next update.

4. • CommentRowNumber4.
   • CommentAuthorAndrew Stacey
   • CommentTimeSep 9th 2009
   • PermaLink
   Author: Andrew Stacey
   Format: MarkdownUpdate done. Please let me know which pages this still affects as I'll have to fix 'em in the database.

   Update done. Please let me know which pages this still affects as I'll have to fix 'em in the database.

5. • CommentRowNumber5.
   • CommentAuthorTobyBartels
   • CommentTimeSep 10th 2009
   • PermaLink
   Author: TobyBartels
   Format: MarkdownI only know of [[fibration sequence]] and [[Sandbox]] offhand, although there certainly are other articles with funky characters in them given by SGML numerical character entities. If and when I find them, then I'll report them here.

   I only know of fibration sequence and Sandbox offhand, although there certainly are other articles with funky characters in them given by SGML numerical character entities. If and when I find them, then I'll report them here.

6. • CommentRowNumber6.
   • CommentAuthorAndrew Stacey
   • CommentTimeSep 10th 2009
   • PermaLink
   Author: Andrew Stacey
   Format: MarkdownUnfortunately, it may be tricky to find. Any page with an entity that was edited in the critical period will have had it converted to the unicode equivalent. Outside iTeX we could just let this pass (or is there a problem with genuine unicode in pages?), but inside iTeX it may be an issue. It'll probably be easier for me to search in the database, if I can figure out how to code "look for all weird characters that were submitted in the last 24 hours".

   Unfortunately, it may be tricky to find. Any page with an entity that was edited in the critical period will have had it converted to the unicode equivalent. Outside iTeX we could just let this pass (or is there a problem with genuine unicode in pages?), but inside iTeX it may be an issue. It'll probably be easier for me to search in the database, if I can figure out how to code "look for all weird characters that were submitted in the last 24 hours".