Like Dawn of the Dragons Community on Facebook! Like Dawn of the Dragons Mobile Community on Facebook!
Page 1 of 2 12 LastLast
Results 1 to 20 of 34

Thread: Sentinel_V's {GreenDragon} UgUp Raid Log Utilities Changelog

  1. #1
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3

    Sentinel_V's UgUp Raid Log Utilities && WC Shared Raid Cacher Changelog

    A collection of utilities to analyze raid performance and serve a cache of active shared raid links.

    Source Code: https://github.com/GreenDragon/dotd_parser

    Production Site: http://green-dragon.systems/form

    Changelog:

    V1.9.4 Added Magic's Applied Icons to Solus Server Raid Cache Screen

    V1.9.3 Schema Changes, Filter on last 500 active, still alive, hooks for magics applied, show percentage remaining, # of members

    V1.9.2 Schema Changes, Make Cached Raid Names More Human Readable

    V1.9.1 Fix default sort for Shared Raids to be by Create_Time Descending

    V1.9.0 Adds Initial Support for Caching Shared World Raids from Facebook ( DotD Solus, Kasan Servers, LoTS )

    V1.8.3 Armaments Table updates

    V1.8.2 LoTS Langauge fixes for Magics vs Tactics, Gold vs Credits. Refactor models/utils*

    V1.8.1 Fixes for Unicode crashes on cron runs. Armament Table updates

    V1.8.0 Edge fixes for new rants, magic damage, missed hits, hard coded armament tables added ( missing in UgUp )

    V1.7.4 Rolled back links to previous logs for performance issues. Parser fixes for concatenated logs.

    V1.7.3 Added support for linking to previous logs

    V1.7.2 Corrections to Sparkline formatting

    V1.7.1 Bootstrap 3.x, web2py 2.10.3 upgrades

    V1.6.2 Refactor Slot Names. Parser correction for errant bad hit counts (odragon reporting).

    V1.6.1 Added Slot Names

    V1.6.0 Streamlined Menu System

    V1.5.X Forked away from contributing further to tsunam.org

    V1.5.2 Last commit to github.com/tsunam/dotd_parser. Fixes for *DEV* Flynn: Mother Knows Best rants

    V1.5.1 Fixes for malformed raid entries

    V1.5.0 Bootstrap Table Upgrades

    V1.4.X LoTS Enhancements, Sparklines

    V1.3.X Parser Stability Fixes

    V1.2.X Several Stability Fixes

    V1.2.0 Added Graphs

    V1.0.0 "Good Enough For Now" Candidate

    V0.0.X 2015.02.21 First commit to tsunam's code base
    Last edited by Sentinel_V; 18th February 2016 at 09:37.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  2. #2
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    v1.9.6 Refactor Backend Caching Mechanism for Performance Issues and Streamline Cached Raid Updates
    V1.9.5 Shared Cache Raid Refactory, Sort Magics/Tactics in Shared Raids by UpUp ID
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  3. #3
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    V1.9.7 RIP LoTS. Adde LoTS Deprecation notices. Harden cron jobs to deal with the occasional transient API call failures.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  4. #4
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    V1.10.1 Refactor Shared Raids Cache, Show *All* the Platforms Now ( Armor Games, Facebook, Kongregate, Newgrounds )
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  5. #5
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    V1.10.2 Updates to Armaments, Handle Intermittent HTTP Server Errors from UgUp Cluster

    V1.11.0 Initial support for analyzing multiple procs during a hit sequence.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  6. #6
    World Mender
    Join Date
    Jun 2011
    Location
    Philadelphia, Pennsylvania, United States
    Posts
    1,474
    Rep Power
    9
    Can I ask why so many of the raids are named incorrectly on the raid shared page? It is odd since there aren't this many misnamings on the Hesperus Raid Conglomerator.

  7. #7
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    I pull the "human" readable raid names from the UgUp server. There was a recent issue when the LoTS UpUp data was missing the "human" name for the raids, so my program falls back to displaying the short raid name from UgUp shared raid query. For example "kulnar_xex_battle_station_1" instead of "K X Battle Station".

    I looked into this a bit more and I see two names from the raid data pulled from the UgUp servers. There's a "name" field as well as a "shortname" field. I was using "name" for DotD, whereas the game UI is using "shortname". I adjusted my cron routine to map img names to "shortname" for DotD moving forward. New raids should show up properly. Older cached raids will have the long "name" for a display until they are expired.

    Thanks for pointing this out.

    MariaDB [dotd_parser]> select id,image,name,shortname from dawn_raids;
    +-----+----------------------------------------------+------------------------------------------+-------------------------+
    | id | image | name | shortname
    | 337 | damned\_shades.jpg | Damned Shade | Shade |
    | 338 | jershanthurns\_portal1.jpg | Jershan'thurn's Portal | Jershan'thurn |
    | 339 | demonic\_skeleton.jpg | Demonic Skeleton | War Skel |
    | 340 | possessed\_cadaver.jpg | Possessed Cadaver | War Cadav |
    | 341 | damned\_shades.jpg | Damned Shade | War Shade |
    | 342 | dasuthaad1.jpg | Dasuthaad's Rising | Dasuthaad |
    | 343 | odius\_pods1.jpg | Odious Pods | Pods |
    | 344 | lord\_hoton\_the\_usurper1.jpg | Lord Hoton the Usurper | Lord Hoton

    Quote Originally Posted by ODragon View Post
    Can I ask why so many of the raids are named incorrectly on the raid shared page? It is odd since there aren't this many misnamings on the Hesperus Raid Conglomerator.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  8. #8
    World Mender
    Join Date
    Jun 2011
    Location
    Philadelphia, Pennsylvania, United States
    Posts
    1,474
    Rep Power
    9
    That's great but that is none of what I meant but I'm glad you are fixing them.

    Valanazes shows up as All That Glitters
    Zralkthalat shows up as Books and Brimstone

    Fog of War is wrong (but we know that's an UgUp, reported

    I believe there might be more. The first two are showing up with the ER version of their name rather than their actual name.

    Right now I refreshed and see: Ash Whelp = rannveig

  9. #9
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    There are 344 different raid names from the UgUp system. I was just showing a few above.

    New DotD shared raids are showing up properly with the shortname display after the cron patch. Older cached raids will still have the long "name" for a display until they expire.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  10. #10
    World Mender
    Join Date
    Jun 2011
    Location
    Philadelphia, Pennsylvania, United States
    Posts
    1,474
    Rep Power
    9
    Quote Originally Posted by Sentinel_V View Post
    There are 344 different raid names from the UgUp system. I was just showing a few above.

    New DotD shared raids are showing up properly with the shortname display after the cron patch. Older cached raids will still have the long "name" for a display until they expire.
    Zralkthalat showed up as Books and Brimstone. It now shows up as just Books.

  11. #11
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    Last entry wins:

    mysql> select id, image, name, shortname from dawn_raids where image like '%zral%';
    +-----+------------------+---------------------+---------------+
    | id | image | name | shortname |
    +-----+------------------+---------------------+---------------+
    | 116 | zralkthalat1.jpg | Z'ralk'thalat | Z'ralk'thalat |
    | 217 | zralkthalat1.jpg | Books and Brimstone | Books |
    +-----+------------------+---------------------+---------------+
    2 rows in set (0.00 sec)
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  12. #12
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    I changed the sql query to sort by maxattacker DESC.

    I've been finding quite a few inconsistencies in naming conventions with data pulled from the UgUp servers, especially with respect to image names.

    | 103 | alice | 90000 | Bandit Queen |
    | 5 | alice | 50 | Alice

    | 297 | blood_dancer | 100 | Blood Dancer |
    | 219 | blood_dancer | 5 | B. Dancer

    | 102 | dragons_lair | 90000 | Ultimate Loot Lair |
    | 75 | dragons_lair | 13 | Lair

    | 53 | echthros | 90000 | Echthros |
    | 182 | echthros | 90000 | Echthros |
    | 79 | echthros | 60000 | Echthrocity |
    | 80 | echthros | 60000 | Echthrocity

    | 233 | gataalli_huxac | 90000 | Gataalli |
    | 234 | gataalli_huxac | 800 | Gataalli



    | 86 | gladiators | 100 | Elite Gladiators |
    | 23 | gladiators | 10 | Gladiators

    | 262 | green_killers | 100 | Green Killers |
    | 218 | green_killers | 5 | G. Killers

    | 120 | grimsly | 90000 | Detention |
    | 55 | grimsly | 50 | Grimsly

    | 66 | kessovfort | 90000 | Fort (Stamina) |
    | 67 | kessovfort | 90000 | Fort (Energy) |
    | 68 | kessovfort | 90000 | Fort (Honor) |
    | 64 | kessovtower | 90000 | Tower (Energy) |
    | 65 | kessovtower | 90000 | Tower (Honor) |
    | 88 | kessovtower | 90000 | Treachery |
    | 63 | kessovtower | 5 | Tower (Scary)







    | 309 | pillagers | 25 | Pillagers |
    | 304 | pillagers | 1 | Pillagers

    | 223 | rannveig | 800 | Immolating Whelp |
    | 224 | rannveig | 800 | Slag Whelp |
    | 225 | rannveig | 800 | Fiery Whelp |
    | 226 | rannveig | 800 | Brimstone Whelp |
    | 227 | rannveig | 800 | Magma Whelp |
    | 228 | rannveig | 800 | Ash Whelp |
    | 216 | rannveig | 250 | Rannveig

    | 108 | ulfrik | 90000 | Slaughter |
    | 35 | ulfrik | 250 | Ulfrik



    | 92 | valanazes | 90000 | All That Glitters |
    | 74 | valanazes | 500 | Valanazes

    | 217 | zralkthalat | 90000 | Books |
    | 116 | zralkthalat | 100 | Z'ralk'thalat
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  13. #13
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    I refactored the cronjob to grab the human names from the shortname field from the raid detail UgUp call now.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  14. #14
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    V1.12.0 RIP LoTS, 2016/02/29, Retire Cached Raids When UgUp reports 0 maxattackers ( glitch space )
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  15. #15
    World Mender
    Join Date
    Jun 2011
    Location
    Philadelphia, Pennsylvania, United States
    Posts
    1,474
    Rep Power
    9
    Just a note that this is not working right for the Omniscient Angel set. Each piece always (as far I can tell) procs 2x, so it is showing up as 2x the proc rate it should on the read-out.

    https://www.green-dragon.systems/par...-f23c91963f4a#

  16. #16
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    If you look at the raw log, the parser is seeing multi-procs ( at least as the parser currently understands multiple procs )

    Crazy Convictions contributed 410,000 damage.
    Pitch Black contributed 2,378,000 damage.
    Thing Two contributed 205,000 damage.
    Sight of the Gods (Crystal Ball) contributed 125,050 damage.
    Sight of the Gods (Crystal Ball) contributed 102,500 damage.
    Sight of the Gods (Legplates) contributed 125,050 damage.
    Sight of the Gods (Legplates) contributed 102,500 damage.
    Sight of the Gods (Band) contributed 125,050 damage.
    Sight of the Gods (Band) contributed 102,500 damage.

    I don't see a multi-attack under the Omniscient Angel set descriptions. Maybe this is how the perception boost is implemented? ( as a proc boost ). I see in the raw logs multi-procs randomly with this set run.

    Thanks
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  17. #17
    World Mender
    Join Date
    Jun 2011
    Location
    Philadelphia, Pennsylvania, United States
    Posts
    1,474
    Rep Power
    9
    Maybe I'm just not explaining well and I apologize for that. My understanding is that the perception proc always procs when the main proc procs, just on a second line which makes things confusing and different from almost any other bonus damage proc that I can think of. There is no chance of having only one proc or the other.

    5x Sight of the Gods (Legplates) contributed 125,050 damage.
    5x Sight of the Gods (Legplates) contributed 102,500 damage.

    On the Proc tab it shows Omniscient Angel's Legplates 10 procs, proc rate of 47.62 %

    I believe that's wrong, I think it should only be proc'd 5/21 = 23.8%. This is much more reasonable to what is in the Damage Procs (4th Gen) page shows (19.51%).

  18. #18
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    Yes, I see.

    My parser counts each hit as a cluster of procs. The parser counts a hit when it sees a line like:
    ODragon dealt 617,810,931 damage! Lost 28 health. Earned 2,107 gold and 29 experience!

    There are many items proc'ing between hits, some multiple times:
    Lost in the Fray contributed 803,600 damage.
    Save for Later contributed 102,500 damage.
    Eye of Karkata (Rune) contributed 20,500 damage.
    Eye of Karkata (Rune) contributed 205,000 damage.
    Sight of the Gods (Third Eye) contributed 125,050 damage.
    Sight of the Gods (Third Eye) contributed 102,500 damage.
    Eye of Karkata (Rune) contributed 20,500 damage.
    Eye of Karkata (Rune) contributed 20,500 damage.


    The current math for the Multi-Proc Rate in the Multi-Proc'ers tab is show the rate in which an item proc'ing procs multiple times in relation to the hits it was seen proc'ing in.

    So for you record, Omniscient Angel's Legplates proc'ed 10 times total and was seen in 5 hits ( 5 sets of dual procs ). So the Multi-Proc Rate is 100% percent in relation to the number of hits this proc item was seen.

    I need to add another field to show multi-proc rate in relation to total hits ( hits seen / hits total ).

    My initial deployment, I was interested in how often each item multi-proc in relation to itself and not total hit count metrics.

    You can also see where multi-proc analysis gets weird counting all the Eye of Karkata procs.

    I will add this hits seen / hits total ration field to the next build later next week. I will rename the "Hits Total" to "Hits Seen" in the Multi-Proc tab to add some clarity.

    Thanks
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  19. #19
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    V1.12.1 Bumps Cached Raids from 500 -> 750 ( War of the World Servers ). Add comparison of multi-proc hits to total hits.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

  20. #20
    Silver Arrow Sentinel_V's Avatar
    Join Date
    Feb 2015
    Location
    Pacific NW, USA
    Posts
    103


    My Platform(s)
    Facebook
    Rep Power
    3
    V1.12.2 Corrects math errors when calculating multi-proc instances. Now shows true count of multi-proc hits and calculates multi-proc rate to self and total hits.
    0NE_Veritas ~ '0NE' on FB:Solus #DevOps
    "GreenDragon" DotD Raid Log Analyzer Programmer @ https://www.green-dragon.systems/

    https://www.youtube.com/watch?v=aCbfMkh940Q

Page 1 of 2 12 LastLast

Similar Threads

  1. Repository of ugup Utilities
    By voorash in forum UgUp Discussions & Suggestions
    Replies: 12
    Last Post: 3rd February 2016, 06:30
  2. Is UgUp doing anything yet?
    By Zero Talent in forum UgUp Discussions & Suggestions
    Replies: 8
    Last Post: 6th August 2014, 04:51
  3. 5pg User Generated Utilities Program
    By Leviticus in forum UgUp Discussions & Suggestions
    Replies: 73
    Last Post: 22nd June 2014, 23:07
  4. 5pg User Generated Utilities Program
    By Leviticus in forum News and Announcements
    Replies: 73
    Last Post: 22nd June 2014, 23:07

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •