[Laszlo-dev] XML Data corruption

Mon Jan 3 01:54:26 PST 2005

Hi Eric,

I've checked the lps.log file and there's no error being logged. I'm
thinking the same thing, character set problem like you do, at the beginning
and that's why I double check it with IE and Firefox.

Here's the raw xml output that saved from Firefox loading the page. The
content is in Chinese. I've opened it with a hex editor and it looks UTF-8
to me. I hope I was wrong.

Regards,
Nevin

-----Original Message-----
From: laszlo-dev-bounces at openlaszlo.org
[mailto:laszlo-dev-bounces at openlaszlo.org] On Behalf Of Eric Bloch
Sent: Monday, January 03, 2005 10:42 AM
To: OpenLaszlo platform development and bug reporting
Subject: Re: [Laszlo-dev] XML Data corruption

You could look in the WEB-INF/lps/work/logs/lps.log to see if there are any
ERROR statements from the server data encoder.

The ???? sounds more like a character set problem, though.  Is the data
always UTF-8 encoded?  Firefox and Explorer can display other charsets and
the Laszlo server data encoder might not be able to convert incoming
character sets to UTF-8.  Henry should have better ideas than me, but I'm up
and thought I'd chime in :-)

Eric

Nevin Ng wrote:
> Hi everyone,
>
> While playing with Laszlo 3.0a2 I'm having problem with the XML data.
> Generally, I'm feeding a Chinese (UTF-8 encoded) XML data from a
> Servlet to Laszlo and from time to time some of the data elements'
> content got corrupted and became displayed as "???????".
>
> The strange part is, it's quite random. So this time the content got
> courrpted doesn't mean next time I cannot get a good one when server
> restarted.
>
> I've check the raw output from the Servlet and the data is fine. Both
> Firefox and Internet Explorer can display the XML using UTF-8 encoding
> without any problem.
>
> The structure of the XML is similar to:
>
> <products>
>    <product>
>       <id>1</id>
>       <name>Diet coke</name>
>       <image>resources/img01.jpg</image>
>       <size>
>          <unit>ml</unit>
>          <weight>0.1</weight>
>       </size>
>    </product>
>    <product>
>      ....
>    </product>
>    <product>
>      ....
>    </product>
> </products>
>
> The XML usually contains 8~12 product in each request.
> Is there any known bug in the XML processing/converting between Laszlo
> Server and Client?
>
>
> _______________________________________________
> Laszlo-dev mailing list
> Laszlo-dev at openlaszlo.org
> http://www.openlaszlo.org/mailman/listinfo/laszlo-dev
_______________________________________________
Laszlo-dev mailing list
Laszlo-dev at openlaszlo.org
http://www.openlaszlo.org/mailman/listinfo/laszlo-dev

!DSPAM:41d8b3cd302102768521343!

begin 666 product.xml
M/#]X;6P@=F5R<VEO;CTB,2XP(B!E;F-O9&EN9STB551&+3 at B/SX*/'!R;V1U
M8W1S/@H\<&%G97,^"CQP86=E(&YU;3TB,2(@<V5L96-T960](G1R=64B+SX*
M/'!A9V4@;G5M/2(R(B!S96QE8W1E9#TB9F%L<V4B+SX*/'!A9V4@;G5M/2(S
M(B!S96QE8W1E9#TB9F%L<V4B+SX*/'!A9V4@;G5M/2(T(B!S96QE8W1E9#TB
M9F%L<V4B+SX*/"]P86=E<SX*/'!R;V1U8W0^"B @/&ED/C0\+VED/@H@(#QC
M871E9V]R>3X*(" @(#QI9#XQ/"]I9#X*(" @(#QN86UE/N:_@^:#A3PO;F%M
M93X*(" @(#QS96QE8W1E9#YF86QS93PO<V5L96-T960^"B @/"]C871E9V]R
M>3X*(" \8V]D93Y&4S Q,#$\+V-O9&4^"B @/&YA;64^YK^#YH.%YIZ<Y[&#
M,3PO;F%M93X*(" \=&AU;6)N86EL/G)E<V]U<F-E<R]P<F]D=6-T+V9S,#$P
M,5]S+FIP9SPO=&AU;6)N86EL/@H@(#QI;6%G93YR97-O=7)C97,O<')O9'5C
M="]F<S Q,#$N:G!G/"]I;6%G93X*(" \<VEZ93X*(" @(#QU;FET/F-M/"]U
M;FET/@H@(" @/&QE;F=T:#XP+C \+VQE;F=T:#X*(" @(#QW:61T:#XP+C \
M+W=I9'1H/@H@(" @/&AE:6=H=#XP+C \+VAE:6=H=#X*(" @(#QW96EG:'0^
M,"XP/"]W96EG:'0^"B @/"]S:7IE/@H@(#QD97-C<FEP=&EO;C[EHZOEI)KE
ME:3FHJCFGISFG9\\+V1E<V-R:7!T:6]N/@H@(#QP<FEC93XR-3 at N,#PO<')I
M8V4^"CPO<')O9'5C=#X\<')O9'5C=#X*(" \:60^-3PO:60^"B @/&-A=&5G
M;W)Y/@H@(" @/&ED/C$\+VED/@H@(" @/&YA;64^YK^#YH.%/"]N86UE/@H@
M(" @/'-E;&5C=&5D/F9A;'-E/"]S96QE8W1E9#X*(" \+V-A=&5G;W)Y/@H@
M(#QC;V1E/D93,#$P,CPO8V]D93X*(" \;F%M93[FOX/F at X7FGISGL8,R/"]N
M86UE/@H@(#QT:'5M8FYA:6P^<F5S;W5R8V5S+W!R;V1U8W0O9G,P,3 R7W,N
M:G!G/"]T:'5M8FYA:6P^"B @/&EM86=E/G)E<V]U<F-E<R]P<F]D=6-T+V9S
M,#$P,BYJ<&<\+VEM86=E/@H@(#QS:7IE/@H@(" @/'5N:70^8VT\+W5N:70^
M"B @(" \;&5N9W1H/C,V+C \+VQE;F=T:#X*(" @(#QW:61T:#XS,"XP/"]W
M:61T:#X*(" @(#QH96EG:'0^.2XP/"]H96EG:'0^"B @(" \=V5I9VAT/C N
M,#PO=V5I9VAT/@H@(#PO<VEZ93X*(" \9&5S8W)I<'1I;VX^Y:.KY:2:Y96D
MYJ*HY8^*Y9N;YJR^YIF"Y+NDZ:ZNYIZ<Z86-Y+NEY86XZ9N%YIZ<Y[&#Y8^*
MYXF]YXF;Y[6RZ(JQY[&0Y+V<Z*.=Z:.^/"]D97-C<FEP=&EO;CX*(" \<')I
M8V4^-#DX+C \+W!R:6-E/@H\+W!R;V1U8W0^/'!R;V1U8W0^"B @/&ED/C8\
M+VED/@H@(#QC871E9V]R>3X*(" @(#QI9#XQ/"]I9#X*(" @(#QN86UE/N:_
M@^:#A3PO;F%M93X*(" @(#QS96QE8W1E9#YF86QS93PO<V5L96-T960^"B @
M/"]C871E9V]R>3X*(" \8V]D93Y&4S Q,#,\+V-O9&4^"B @/&YA;64^YK^#
MYH.%YIZ<Y[&#,SPO;F%M93X*(" \=&AU;6)N86EL/G)E<V]U<F-E<R]P<F]D
M=6-T+V9S,#$P,U]S+FIP9SPO=&AU;6)N86EL/@H@(#QI;6%G93YR97-O=7)C
M97,O<')O9'5C="]F<S Q,#,N:G!G/"]I;6%G93X*(" \<VEZ93X*(" @(#QU
M;FET/F-M/"]U;FET/@H@(" @/&QE;F=T:#XS,BXP/"]L96YG=&@^"B @(" \
M=VED=&@^,C,N,#PO=VED=&@^"B @(" \:&5I9VAT/C$S+C \+VAE:6=H=#X*
M(" @(#QW96EG:'0^,"XP/"]W96EG:'0^"B @/"]S:7IE/@H@(#QD97-C<FEP
M=&EO;C[EA:WFK+[FF8+DNZ3IKJ[FGISIA8WEHZOEI)KEE:3FHJ@\+V1E<V-R
M:7!T:6]N/@H@(#QP<FEC93XT,S at N,#PO<')I8V4^"CPO<')O9'5C=#X\<')O
M9'5C=#X*(" \:60^-SPO:60^"B @/&-A=&5G;W)Y/@H@(" @/&ED/C$\+VED
M/@H@(" @/&YA;64^YK^#YH.%/"]N86UE/@H@(" @/'-E;&5C=&5D/F9A;'-E
M/"]S96QE8W1E9#X*(" \+V-A=&5G;W)Y/@H@(#QC;V1E/D93,#$P-#PO8V]D
M93X*(" \;F%M93[FOX/F at X7FGISGL8,T/"]N86UE/@H@(#QT:'5M8FYA:6P^
M<F5S;W5R8V5S+W!R;V1U8W0O9G,P,3 T7W,N:G!G/"]T:'5M8FYA:6P^"B @
M/&EM86=E/G)E<V]U<F-E<R]P<F]D=6-T+V9S,#$P-"YJ<&<\+VEM86=E/@H@
M(#QS:7IE/@H@(" @/'5N:70^8VT\+W5N:70^"B @(" \;&5N9W1H/C(U+C \
M+VQE;F=T:#X*(" @(#QW:61T:#XQ-RXP/"]W:61T:#X*(" @(#QH96EG:'0^
M-RXU/"]H96EG:'0^"B @(" \=V5I9VAT/C N,#PO=V5I9VAT/@H@(#PO<VEZ
M93X*(" \9&5S8W)I<'1I;VX^Y+J4YJR^YIF"Y+NDZ:ZNYIZ<Z86-Y:.KY:2:
MY96DYJ*H/"]D97-C<FEP=&EO;CX*(" \<')I8V4^-#8X+C \+W!R:6-E/@H\
M+W!R;V1U8W0^/'!R;V1U8W0^"B @/&ED/C@\+VED/@H@(#QC871E9V]R>3X*
M(" @(#QI9#XQ/"]I9#X*(" @(#QN86UE/N:_@^:#A3PO;F%M93X*(" @(#QS
M96QE8W1E9#YF86QS93PO<V5L96-T960^"B @/"]C871E9V]R>3X*(" \8V]D
M93Y&4S V,#$\+V-O9&4^"B @/&YA;64^YK^#YH.%YIZ<Y[&#-3PO;F%M93X*
M(" \=&AU;6)N86EL/G)E<V]U<F-E<R]P<F]D=6-T+V9S,#8P,5]S+FIP9SPO
M=&AU;6)N86EL/@H@(#QI;6%G93YR97-O=7)C97,O<')O9'5C="]F<S V,#$N
M:G!G/"]I;6%G93X*(" \<VEZ93X*(" @(#QU;FET/F-M/"]U;FET/@H@(" @
M/&QE;F=T:#XS,RXP/"]L96YG=&@^"B @(" \=VED=&@^,S0N,#PO=VED=&@^
M"B @(" \:&5I9VAT/CDN,#PO:&5I9VAT/@H@(" @/'=E:6=H=#XP+C \+W=E
M:6=H=#X*(" \+W-I>F4^"B @/&1E<V-R:7!T:6]N/N6%K>:LON:9 at N2[I.FN
MKN:>G#PO9&5S8W)I<'1I;VX^"B @/'!R:6-E/C,X."XP/"]P<FEC93X*/"]P
M<F]D=6-T/CQP<F]D=6-T/@H@(#QI9#XY/"]I9#X*(" \8V%T96=O<GD^"B @
M(" \:60^,3PO:60^"B @(" \;F%M93[FOX/F at X4\+VYA;64^"B @(" \<V5L
M96-T960^9F%L<V4\+W-E;&5C=&5D/@H@(#PO8V%T96=O<GD^"B @/&-O9&4^
M1E,P-C R/"]C;V1E/@H@(#QN86UE/N:_@^:#A>:>G.>Q at S8\+VYA;64^"B @
M/'1H=6UB;F%I;#YR97-O=7)C97,O<')O9'5C="]F<S V,#)?<RYJ<&<\+W1H
M=6UB;F%I;#X*(" \:6UA9V4^<F5S;W5R8V5S+W!R;V1U8W0O9G,P-C R+FIP
M9SPO:6UA9V4^"B @/'-I>F4^"B @(" \=6YI=#YC;3PO=6YI=#X*(" @(#QL
M96YG=&@^-3 N,#PO;&5N9W1H/@H@(" @/'=I9'1H/C,X+C \+W=I9'1H/@H@
M(" @/&AE:6=H=#XQ."XP/"]H96EG:'0^"B @(" \=V5I9VAT/C N,#PO=V5I
M9VAT/@H@(#PO<VEZ93X*(" \9&5S8W)I<'1I;VX^Y86KYJR^YIF"Y+NDZ:ZN
MYIZ</"]D97-C<FEP=&EO;CX*(" \<')I8V4^-#@X+C \+W!R:6-E/@H\+W!R
M;V1U8W0^/'!R;V1U8W0^"B @/&ED/C$\+VED/@H@(#QC871E9V]R>3X*(" @
M(#QI9#XR/"]I9#X*(" @(#QN86UE/N66K.F!MSPO;F%M93X*(" @(#QS96QE
M8W1E9#YF86QS93PO<V5L96-T960^"B @/"]C871E9V]R>3X*(" \8V]D93Y&
M4S R,#$\+V-O9&4^"B @/&YA;64^Y9:LZ8&WYIZ<Y[&#,3PO;F%M93X*(" \
M=&AU;6)N86EL/G)E<V]U<F-E<R]P<F]D=6-T+V9S,#(P,5]S+FIP9SPO=&AU
M;6)N86EL/@H@(#QI;6%G93YR97-O=7)C97,O<')O9'5C="]F<S R,#$N:G!G
M/"]I;6%G93X*(" \<VEZ93X*(" @(#QU;FET/F-M/"]U;FET/@H@(" @/&QE
M;F=T:#XT,"XP/"]L96YG=&@^"B @(" \=VED=&@^,S,N,#PO=VED=&@^"B @
M(" \:&5I9VAT/C at N,#PO:&5I9VAT/@H@(" @/'=E:6=H=#XP+C \+W=E:6=H
M=#X*(" \+W-I>F4^"B @/&1E<V-R:7!T:6]N/N2YG>:LON:9 at N2[I.FNKN:>
MG#PO9&5S8W)I<'1I;VX^"B @/'!R:6-E/C0P."XP/"]P<FEC93X*/"]P<F]D
M=6-T/CQP<F]D=6-T/@H@(#QI9#XR/"]I9#X*(" \8V%T96=O<GD^"B @(" \
M:60^,CPO:60^"B @(" \;F%M93[EEJSI@;<\+VYA;64^"B @(" \<V5L96-T
M960^9F%L<V4\+W-E;&5C=&5D/@H@(#PO8V%T96=O<GD^"B @/&-O9&4^1E,P
M,S Q/"]C;V1E/@H@(#QN86UE/N66K.F!M^:>G.>Q at S(\+VYA;64^"B @/'1H
M=6UB;F%I;#YR97-O=7)C97,O<')O9'5C="]F<S S,#%?<RYJ<&<\+W1H=6UB
M;F%I;#X*(" \:6UA9V4^<F5S;W5R8V5S+W!R;V1U8W0O9G,P,S Q+FIP9SPO
M:6UA9V4^"B @/'-I>F4^"B @(" \=6YI=#YC;3PO=6YI=#X*(" @(#QL96YG
M=&@^,S,N,#PO;&5N9W1H/@H@(" @/'=I9'1H/C(W+C \+W=I9'1H/@H@(" @
M/&AE:6=H=#XQ,RXP/"]H96EG:'0^"B @(" \=V5I9VAT/C N,#PO=V5I9VAT
M/@H@(#PO<VEZ93X*(" \9&5S8W)I<'1I;VX^Y86MYJR^YIF"Y+NDZ:ZNYIZ<
MXX"!YH2/Y:2GY8BIY[*)Y+B Y8R%XX"!Z::9Z(V)YH2/Y[*)Z8:LY+B YY.V
MXX"!YIR)YJF?Y[24YIRQY8^DY8J;Y+B Y8R%/"]D97-C<FEP=&EO;CX*(" \
I<')I8V4^,SDX+C \+W!R:6-E/@H\+W!R;V1U8W0^/"]P<F]D=6-T<SX`
`
end