By default, Bugzilla does not search the list of RESOLVED bugs.
You can force it to do so by putting the upper-case word ALL in front of your search query, e.g.: ALL tdelibs
We recommend searching for bugs this way, as you may discover that your bug has already been resolved and fixed in a later release.

Bug 774

Summary: Konqueror user agent spoofs are woefully out of date
Product: TDE Reporter: Darrell <darrella>
Component: tdebaseAssignee: Timothy Pearson <kb9vqf>
Status: PATCHAVAIL ---    
Severity: minor CC: bugwatch, darrella, julius.schwartzenberg, mutantturkey, slavek.banko
Priority: P1    
Version: R14.0.x [Trinity]   
Hardware: Other   
OS: All   
Compiler Version: TDE Version String:
Application Version: Application Name: Konqueror
Attachments: Updated User Agent Strings
Patch updated for kdebase -> tdebase renaming
Fix make files because of deleting obsolete UA desktop files

Description Darrell 2011-12-27 17:07:15 CST
Konqueror provides an option to spoof the user agent. These options are woefully out of date and should be updated.

Possibly we want to keep all of the existing UAs, just to have fun with web tracking, but we should have UAs that match browsers of the past 2-3 years.

Source files are located at kdebase/kcontrol/kio/uasproviders and are installed at $PREFIX/share/services/useragentstrings.

I probably can help with this but need a list of candidates. I'm not really tuned into this kind of thing to create a good candidate list. :)
Comment 1 Calvin Morrison 2012-01-01 18:53:44 CST
Interesting: http://user-agent-string.info/top-ua

maybe we should pick a few big ones.

IE6, IE7, IE8
Chrome, Chromium,
Firefox 3.6, Firefox 4+
Opera 11

All I can think of, but probably covers 99% of bases. Also a generic webkit one 
would be good.

Any thoughts? I can submit a patch if we decide on one.
Comment 2 Darrell 2012-01-01 21:55:39 CST
Chromium/Chrome/Safari are webkit.

For Firefox perhaps 3.6, 4, 4.0.1, 5.0, 6.0, 7.0, 8.0, 8.0.1, 9, 9.0.1.

These files should be checked and updated each release. We should create some kind of tickler so that happens?
Comment 3 Calvin Morrison 2012-01-02 22:51:01 CST
Okay,

Chromium actually uses it's own branch of webkit. I think it deserves it's own ID.

Safari also is important to have. it's not about the rendering engine but also certain websites interact differently with different strings.

I say 1 for:
Chrome 
Safari
Firefox 3.6, 4.0, after that it's totally up in the air because of their versioning scheme maybe 7
Comment 4 Calvin Morrison 2012-01-02 22:57:54 CST
Okay,

Chromium actually uses it's own branch of webkit. I think it deserves it's own ID.

Safari also is important to have. it's not about the rendering engine but also certain websites interact differently with different strings.

I say 1 for:
Chrome 
Safari
Firefox 3.6, 4.0, after that it's totally up in the air because of their versioning scheme maybe 7
Comment 5 Darrell 2012-01-02 23:01:39 CST
Created attachment 248 [details]
Updated User Agent Strings

My best shot at an updated UA string list.

Old list:

firefox10oncurrent.desktop
firefox15oncurrent.desktop
googlebot.desktop
ie401onwinnt4.desktop
ie45onwinnt5.desktop
ie501onwinnt5.desktop
ie50onppc.desktop
ie55onwin98.desktop
ie55onwinnt5.desktop
ie60oncurrent.desktop
ie60onwinnt51.desktop
lynxoncurrent.desktop
mozoncurrent.desktop
mozoncurrent12.desktop
mozoncurrent16.desktop
mozonwin2000.desktop
mozonwinxp.desktop
nn301oncurrent.desktop
nn475oncurrent.desktop
nn475onwin95.desktop
nn476onppc.desktop
ns71oncurrent.desktop
ns71onwinnt51.desktop
op403onwinnt4.desktop
op75oncurrent.desktop
safari12.desktop
safari20.desktop
w3moncurrent.desktop
wgetoncurrent.desktop

New list:

android10.desktop
chrome100oncurrent.desktop
chrome110oncurrent.desktop
chrome120oncurrent.desktop
chrome130oncurrent.desktop
chrome140oncurrent.desktop
chrome150oncurrent.desktop
chrome160oncurrent.desktop
firefox30oncurrent.desktop
firefox36oncurrent.desktop
firefox401oncurrent.desktop
firefox40oncurrent.desktop
firefox50oncurrent.desktop
firefox60oncurrent.desktop
firefox70oncurrent.desktop
firefox801oncurrent.desktop
firefox80oncurrent.desktop
firefox901oncurrent.desktop
firefox90oncurrent.desktop
ie401onwinnt4.desktop
ie45onwinnt5.desktop
ie501onwinnt5.desktop
ie50onppc.desktop
ie55onwin98.desktop
ie55onwinnt5.desktop
ie60oncurrent.desktop
ie60onwinnt51.desktop
ie70onwinnt51.desktop
lynxoncurrent.desktop
ns71oncurrent.desktop
ns71onwinnt51.desktop
op106oncurrent.desktop
op116oncurrent.desktop
op75oncurrent.desktop
op85oncurrent.desktop
op96oncurrent.desktop
safari40.desktop
safari501oniphone.desktop
safari51.desktop
w3moncurrent.desktop
wgetoncurrent.desktop
Comment 6 Calvin Morrison 2012-01-02 23:32:18 CST
Ok. this is a good start.

Lets add IE's more recent versions as well. We can't forget that they are now on IE9 (IE10 soon?) Lets get at least 789 there.
Comment 7 Darrell 2012-01-03 00:14:38 CST
I started to do that (really!), but I'm so out of touch with Windows and IE that I gave up trying to figure out how to match newer IE versions with appropriate/reasonable Windows versions. :) I don't know which IE version came with Windows XP, Windows 6 (Vista?) or 7. I don't know which newer IE versions are compatible with the older Windows versions. For example, I'm guessing the latest IE is not installable on W2K or XP. Somebody who uses Windows daily will need to add those UA strings. :)

For the Opera versions I visited their web site and used the last minor version of each major version.
Comment 8 Calvin Morrison 2012-01-03 09:28:38 CST
I am not sure if older windows supports newer IE. the newer IE is vastly different than the old IE6 rendering engine you might remember.

Opera looks good to me.
Comment 9 Darrell 2012-01-03 10:22:50 CST
Yeah, that's my point. I did not want to create bogus combinations, such as IE9 with W2K. Somebody familiar with the Windows world should be able to create some new rational strings and we'd be done.

My use of Windows is limited to an old version in a virtual machine.
Comment 10 Calvin Morrison 2012-01-03 17:29:53 CST
As is mine.

Googling gives me a good list:

http://www.useragentstring.com/pages/Internet%20Explorer/

we can extract the simplest ones for 7 8 9 10.

My next issue is this: why can't the user specify this manually! it seems ridiculous (or can he?)
Comment 11 Darrell 2012-01-03 17:55:14 CST
Not sure what you mean by "manually."

I have to open a web page before the user agent options appear in the Tools menu or the button appears in the toolbar. Apparently the user agent support is context sensitive abd appears only when deemed appropriate.

There is a Configure option when selecting the menu or button. I don't see a way to manually type a UA --- only to select from the pick list.
Comment 12 Timothy Pearson 2012-01-11 17:52:15 CST
OK guys, is this ready to commit? :)  I'm leaving the user agent stuff fully up to those who know more about other OS/browser options than I do...
Comment 13 Darrell 2012-01-11 19:16:20 CST
Calvin wanted to add more recent IE user agents. I presumed he was going to do that.

My patch is ready to commit. If you want to keep this report open until Calvin submits an IE patch then I'm fine with that.

Up to you fearless leader!
Comment 14 Darrell 2012-02-22 17:59:46 CST
Created attachment 408 [details]
Patch updated for kdebase -> tdebase renaming
Comment 15 Darrell 2012-02-22 18:02:26 CST
Created attachment 409 [details]
Fix make files because of deleting obsolete UA desktop files

The previous patch, updated for kdebase -> tdebase renaming, deletes several obsolete user agent *.desktop files. The make files need updating as well in order to not try to install those deleted *.desktop files.
Comment 16 Darrell 2012-02-25 00:36:28 CST
User agent strings updated in GIT hash 618e7f195065cdc19b86f4c1ffe6b94d2b6a64ae. IE related strings not yet updated.
Comment 17 Calvin Morrison 2012-02-25 10:14:08 CST
okay sorry I haven't  given this bug much detail.


Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; Trident/6.0)
Mozilla/5.0 (Windows; U; MSIE 9.0; WIndows NT 9.0; en-US)
Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; SLCC1; .NET CLR 1.1.4322)
Mozilla/5.0 (Windows; U; MSIE 7.0; Windows NT 6.0; en-US)

Thats all we should add.


We also probably do not need that many versions of chrome. Chrome is rolling release, nobody ever even talks about the version numbers - it's hidden from the users and on windows/mac automatically and silents updates so you dont even know.

Chrome is much more "always use the new one"

also they are flying through release versions..

Calvin
Comment 18 Darrell 2012-02-25 11:01:08 CST
I added a list tiem in our pre-release etherpad check list to verify konqueror user agent strings are reasonably current.

You said you would update the IE strings and I'll let you do that. :) Just remember that when you delete or rename *.desktop files that the patch must include those changes too and not just the string changes, which is why I had to add a second patch. :)
Comment 19 Timothy Pearson 2012-06-10 02:04:58 CDT
Any progress on this?  If the patches have already been pushed to GIT then they should be marked obsolete and this bug report should be reevaluated to see why it is still open.  If they have not been pushed to GIT yet, then why haven't they been? ;-)
Comment 20 Darrell 2012-06-10 11:56:31 CDT
I don't think the IE strings were updated.
Comment 21 Timothy Pearson 2012-06-13 15:57:12 CDT
(In reply to comment #20)
> I don't think the IE strings were updated.

Why not?
Comment 22 Darrell 2012-06-13 17:09:14 CDT
Because neither Calvin (Comment 10) nor I (Comment 7,9) use Windows/IE and both of us are uncomfortable creating legitimate UA strings (matching IE version with Windows version). Looks like Calvin made a short stab in Comment 17, but I don't know whether those will suffice.

We have this item covered in our etherpad pre-release check list.
Comment 23 Timothy Pearson 2012-06-13 17:15:24 CDT
Ah, OK.  Thanks for the information!
Comment 24 Darrell 2012-06-13 17:43:12 CDT
Possibly for future reference, with respect to our etherpad check list, is somebody who is familiar with Windows create a simple matrix of OS versions versus IE versions. Maybe we should just ask for that help in the mail list. A simple matrix helps future volunteers with updating the UA strings with legitimate combinations. For example we don't want to create a UA string with IE 10 and WFWG 3.11. That kind of thing is great for monkey-wrenching data mining, but probably not what we want in our UA set. :-)
Comment 25 Timothy Pearson 2012-06-13 17:48:40 CDT
A little information is available here:
http://en.wikipedia.org/wiki/Internet_Explorer_9#User_agent_string
Comment 26 Julius Schwartzenberg 2012-06-13 18:07:32 CDT
Do you actually have any examples of websites that still need this?

I would not change any of the list, even if it's outdated because:

1. The sites that actually need this spoofing are likely also old and they are more likely to work with an outdated UA string as well.
2. Konqueror's renderder is not up to date either, specifying a UA string from a more modern browser version, could have a worse effect than sending one from an older browser.

If it turns out that not a single site needs this anymore (hard to verify though), better remove this feature all together.

In any case, I would never add a UA string if there is not at least a single site that starts working better in Konqueror by selecting it. Adding modern, but in practice useless UA strings, will only cause confusion.