Switch Theme:

On Dice and accuracy  [RSS] Share on facebook Share on Twitter Submit to Reddit
»
Author Message
Advert


Forum adverts like this one are shown to any user who is not logged in. Join us by filling out a tiny 3 field form and you will get your own, free, dakka user account which gives a good range of benefits to you:
  • No adverts like this in the forums anymore.
  • Times and dates in your local timezone.
  • Full tracking of what you have read so you can skip to your first unread post, easily see what has changed since you last logged in, and easily see what is new at a glance.
  • Email notifications for threads you want to watch closely.
  • Being a part of the oldest wargaming community on the net.
If you are already a member then feel free to login now.




Made in us
Freaky Flayed One





Long Island, NY

I wanted to get peoples opinions on dice and their impact on the game. I decided to take a look at some of the dice I commonly use to see if there was any inherent differences between them. I want to provide 2 examples that really jumped out; my best and worst.

In the following two data sets I decided to do some batch testing. I took 10 dice for each group and rolled them 30 times for a total of 300 rolls with the results shown below.







The first thing that jumped out is that the GW dice have a serious bias towards the number 3 at a detriment to just about everything else. The GW dice also demonstrated a standard deviation of more than 3 times that of the chessex dice.

The thinking with the batch (10) rolling was that if there are random manufacturing biases, during polishing for example, that they should balance each other out with batch rolling however, with the GW dice that appears to not be the case. I'm working on individual rolling stats now for comparison, but I wanted to get peoples thoughts on this. It seems like depending on what you use, you could be introducing huge biases to the game.

Side note: I'm not a professional statistician, so if I did something dumb, let me know.

DA KRIMSON KLAWZ
 
   
Made in us
Stormblade



SpaceCoast

Engineer so not a statistician but know enough to be dangerous. The standard deviation on the GW set looks way off (and maybe slightly off on the chessex). I also wonder if 300 rolls is enough is there still a heavy randomess element or are you really starting to see manufacturing biases ? There's probably some formula you could use or maybe just repeat the experiment with the same set of dice and see if you get the same results.
   
Made in fr
Longtime Dakkanaut




76 is a very high number. The probability of rolling at least 76 3s when rolling 300 fair dice is 0.005%.
In other words, 300 rolls is a sufficiently large number of rolls to conclude that the GW dice are far from fair.
   
Made in ca
Junior Officer with Laspistol





London, Ontario

The repeated experiment would be the key to seeing a pattern. Ensuring sufficient randomization before the “throw” would also be important. If you always use the same pattern of placing the dice in a cup, shake twice and roll from the same height, you may unexpectedly be creating a bias.

From there, determining if all dice are flawed, or just one or two. While extreme, one die that always shows a 3 would skew your results tremendously.

This message was edited 1 time. Last update was at 2019/02/26 14:43:46


 
   
Made in gb
Fixture of Dakka






First thing that springs to mind is, check another cube. Secondly, who makes GW's dice and who makes anyone else's dice.
   
Made in us
Freaky Flayed One





Long Island, NY

I've included the raw roll data for the GW dice below. As far as the bias towards the 3 side, it isn't just a single dice or two skewing the stats. If you look in the 3 column, you see multiple instances of multiple 3's being rolled.

If you take the average count for each column, you get the following:

1=1.40
2=1.70
3=2.53
4=1.57
5=1.31
6=1.53





Automatically Appended Next Post:
I'll definitely try repeating the experiment. I'll let you know what I find.


Automatically Appended Next Post:
I'm not sure who makes the GW solid red dice. They are those red (also come in white) dice that have come with everything over the years.


Automatically Appended Next Post:
Here are the other dice sets that I ran,





This message was edited 4 times. Last update was at 2019/02/26 15:29:44


DA KRIMSON KLAWZ
 
   
Made in ca
Lone Wolf Sentinel Pilot





Los Angeles, CA, USA

30 rolls seems like a very small data set to me. Something more like 300 rolls would likely even out those outliers.

That’s the real point of dice anyway, to provide a more or less average set of random numbers over time.
   
Made in us
Freaky Flayed One





Long Island, NY

Well its 30 rolls with 10 dice roll each for a total of 300 unique rolls. This initial round was for batch testing. The idea was that randomly introduce manufacturing defects should balance each other out when using 10 dice unless there is a non-random bias (injection point/flash bias for example).

DA KRIMSON KLAWZ
 
   
Made in us
Nasty Nob






Some dice have air bubbles or other imperfections in them. This is more obvious with translucent dice than opaque dice.

This might interest you:
https://makezine.com/2015/06/16/check-balance-gaming-dice/


My P&M blog: Cleatus, the Scratch-building Mekboy
Successful Swap Trades: 6 
   
Made in us
Freaky Flayed One





Long Island, NY

Cleatus


I'm going to have to try both the salt water float test and cutting one of these die in half. Thanks for the link.

DA KRIMSON KLAWZ
 
   
Made in us
Stormblade



SpaceCoast

I figured out why your stddev looks weird, you calculated the stddev of the totals not of the individual dice rolls.

Also you might find this interesting.
http://ccnmtl.columbia.edu/projects/qmss/the_chisquare_test/about_the_chisquare_test.html
   
Made in us
Freaky Flayed One





Long Island, NY

Jerram


I did find that interesting thanks. If I understood that correctly, would I be accurate in saying that the if all of the dice were fair, then Chessex orange/clear had an 87.61% chance of rolling those values whereas the GW solid red had only a 0.27% chance?





DA KRIMSON KLAWZ
 
   
Made in us
Stormblade



SpaceCoast

I think so, I tried calculating the chessex value and just grabbed any old table that probably had lower fidelity than the one you used and got <90%.
   
Made in us
Quick-fingered Warlord Moderatus







I literally cannot believe that you haven't seen this article on dakka yet...

https://www.dakkadakka.com/wiki/en/That's_How_I_Roll_-_A_Scientific_Analysis_of_Dice

This article is the reason i spent ~£60 on 'Vegas Dice' and started a YouTube gaming channel with the same name..

https://www.youtube.com/channel/UC-px27tzAtVwZpZ4ljopV2w "ashtrays and teacups do not count as cover"
"jack of all trades, master of none; certainly better than a master of one"
The Ordo Reductor - the guy's who make wonderful things like the Landraider Achillies, but can't use them in battle..  
   
Made in us
Freaky Flayed One





Long Island, NY

SirDonlad
I literally cannot believe that you haven't seen this article on dakka yet...

https://www.dakkadakka.com/wiki/en/That's_How_I_Roll_-_A_Scientific_Analysis_of_Dice

This article is the reason i spent ~£60 on 'Vegas Dice' and started a YouTube gaming channel with the same name..


I actually didn't see that, thanks for posting it. Quite a bit comes back if you search this forum for "dice" and related terms. The article was very interesting. I ordered some of the vegas dice mentioned, I'm curious to try them out.

DA KRIMSON KLAWZ
 
   
Made in gb
Fixture of Dakka






Casino dice are designed to be thrown vigorously the length of a craps table; if you're dropping them into a dice tray or a space on the table between a ruin and a squad of Marines, they won't roll enough to randomise properly. Plus, you really should replace them frequently; that's why casinos sell dice as souvenirs, those are the ones they're about to bin.
   
Made in us
The Hammer of Witches





A new day, a new time zone.

 SirDonlad wrote:
I literally cannot believe that you haven't seen this article on dakka yet...

https://www.dakkadakka.com/wiki/en/That's_How_I_Roll_-_A_Scientific_Analysis_of_Dice

This article is the reason i spent ~£60 on 'Vegas Dice' and started a YouTube gaming channel with the same name..

Why on earth did you do that?

"-Nonsense, the Inquisitor and his retinue are our hounoured guests, of course we should invite them to celebrate Four-armed Emperor-day with us..."
Thought for the Day - Never use the powerfist hand to wipe. 
   
Made in gb
Ridin' on a Snotling Pump Wagon






Hold on.

Which GW Dice? I use the ones in the old plastic cubes shaped like a die.

Are you testing with newer ones? Have you tried a different set?

Fed up of Scalpers? But still want your Exclusives? Why not join us?

Hey look! It’s my 2025 Hobby Log/Blog/Project/Whatevs 
   
Made in us
Irked Necron Immortal





Jackson, TN

 SirDonlad wrote:
I literally cannot believe that you haven't seen this article on dakka yet...

https://www.dakkadakka.com/wiki/en/That's_How_I_Roll_-_A_Scientific_Analysis_of_Dice

This article is the reason i spent ~£60 on 'Vegas Dice' and started a YouTube gaming channel with the same name..


Before I read that write up a long time ago, I bought the Chessex 12mm rounded corner dice, they were nice as wound markers and small enough that when I had to roll a ton of them it was easy.

But I did notice the 1 was showing up more than it should have, even had opponents comment on it, even let them use the dice with similar 1s showing up more. At first I attributed it to the fact people tend to notice the negative more than the positive.

Then I did my research and sure enough, it seemed to be an actual trend.

I ended up getting 16mm more of a square corner dice ( https://diceemporium.com/product/16mm-square-corner-dice-sets/ ), these are not casino level, but good and they have been a lot more reliable at being evenly random.
   
Made in us
Irked Necron Immortal






Halifax, NS

The GW Solid Red dice are just horrible.

I was playing a game the other day and out of 50 dice roles over a single game turn (charges, shooting (to hit and wound), as well as Assaults (to hit and wound) I rolled 40 1's and 2's

It was completely flabbergasting. My opponent couldn't believe the sheer amount of "fail" rolled during a single turn.

 
   
Made in fi
Longtime Dakkanaut




 SirDonlad wrote:
I literally cannot believe that you haven't seen this article on dakka yet...

https://www.dakkadakka.com/wiki/en/That's_How_I_Roll_-_A_Scientific_Analysis_of_Dice


This article pops up every now and then. Most people think it is nonsense: nobody has been able to duplicate the results.

I have done 600 throw test (60x10 dice) with my blue opaque Citadel dice. Distribution was very close to standard deviation and got more close to it as the test progressed. In fact '1' was the least common result.

Mr Vetock, give back my Multi-tracker! 
   
Made in fi
Locked in the Tower of Amareo





People generally underestimate how long it takes for variance to even out. In poker they go "yey 10000 hands and i'm winner". Even 100000 hands isn't really enough to be sure you are winner and it wasn't just variance smiling for you...

2024 painted/bought: 109/109 
   
Made in us
Quick-fingered Warlord Moderatus







Bookwrack wrote:
Why on earth did you do that?

I wanted to be sure that whatever the result of a roll was, that it was the fairest roll you cold have - now if i roll a huge number of ones or whatever, i know it is a genuine result and i can deal with it a hell of a lot better.
I knew i would need 20 minimum per side and i don't want to use the same colour dice as my opponent so the outlay was worth it to me - plus they are nice and visible on video provided the glare of the lights don't catch off the surface.

https://www.youtube.com/channel/UC-px27tzAtVwZpZ4ljopV2w "ashtrays and teacups do not count as cover"
"jack of all trades, master of none; certainly better than a master of one"
The Ordo Reductor - the guy's who make wonderful things like the Landraider Achillies, but can't use them in battle..  
   
Made in us
Combat Jumping Ragik






Beyond the Beltway

These sorts of discussions pop up in Role Playing Game forums too. It is a very deep rabbit hole. People wondering about the 20 sided dice, and other polyhedrals .

I'll summarize. Yes, there is some bias in the dice. The dice with the least bias are GameScience dice-- once they are properly trimmed-- when it comes to polyhedrals. The amount of bias is not significant unless there are large sums of money involved. Chessex and Koplow dice are just fine since the difference between them and Gamescience is negligible, unless, y'know, big money. There are some truly crappy dice. Wiz Dice for example. Transparent dice are preferable, because one can see if there are air pockets in them, and avoid those dice.

You can start here, http://deltasdnd.blogspot.com/2009/02/testing-balanced-die.html The author is a College lecturer in mathematics and computer science so qualified. There are, if you search, other interesting blogs where the authors build dice rolling machines and hook them up to cameras to automate rolling and recording.

A final thought: Casinos swap out the dice frequently because rolling the dice rounds the corners and this introduces bias.

 
   
Made in au
Dakka Veteran





Sydney, Australia

tneva82 wrote:
People generally underestimate how long it takes for variance to even out. In poker they go "yey 10000 hands and i'm winner". Even 100000 hands isn't really enough to be sure you are winner and it wasn't just variance smiling for you...


That's a terrible example. A standard deck of cards has billions of trillions of combinations possible, a d6 has far, far less (at its core its 52 vs 6). "Evening out" in a deck of cards is nigh impossible, on a d6 its very easy because there are far less possible combinations, and you can calculate when a specific dice reaches near parity in terms of results

DC:90S++G+++MB+IPvsf17#++D++A+++/mWD409R+++T(Ot)DM+

I mainly play 30k, but am still fairly active with 40k. I play Warcry, Arena Rex, Middle-Earth, Blood Bowl, Batman, Star Wars Legion as well

My plog- https://www.dakkadakka.com/dakkaforum/posts/list/787134.page
My blog- https://fistfulofminiatures.blogspot.com/
My gaming Instagram- https://www.instagram.com/fistfulofminis/ 
   
Made in gb
Ridin' on a Snotling Pump Wagon






Not if you’re looking for statistical signifance.

The point he’s making is clear, is it not? That none of us here are likely to roll enough D6 in a lifetime to be of statistical significance.

Fed up of Scalpers? But still want your Exclusives? Why not join us?

Hey look! It’s my 2025 Hobby Log/Blog/Project/Whatevs 
   
Made in us
Freaky Flayed One





Long Island, NY

 Rygnan wrote:
tneva82 wrote:
People generally underestimate how long it takes for variance to even out. In poker they go "yey 10000 hands and i'm winner". Even 100000 hands isn't really enough to be sure you are winner and it wasn't just variance smiling for you...


That's a terrible example. A standard deck of cards has billions of trillions of combinations possible, a d6 has far, far less (at its core its 52 vs 6). "Evening out" in a deck of cards is nigh impossible, on a d6 its very easy because there are far less possible combinations, and you can calculate when a specific dice reaches near parity in terms of results


I agree with Rygnan on this. A deck of cards has far, far more combinations than a simple D6. In the card example you have 52 unique cards to be drawn randomly and the probability changes as cards are removed. A D6 is always 1 of 6 sides and that doesn't change with multiple rolls.

Below are my results from yesterday. What your looking at is a total of 600 rolls (10 dice x 60 rolls). All dice are clearly not created equal. For the GW red dice, if everything was true random, the chance of rolling that combination is less than 1%.



DA KRIMSON KLAWZ
 
   
Made in fi
Locked in the Tower of Amareo





I'm not saying you need 100k's of dice rolls...But 600 is pretty small amount. Expecting it to be exactly 100 of each is pretty silly.

And less than 1% events happen periodically anyway. You are acting like less than 1%=impossible.

This message was edited 1 time. Last update was at 2019/03/04 13:46:06


2024 painted/bought: 109/109 
   
Made in us
Freaky Flayed One





Long Island, NY

tneva82 wrote:
I'm not saying you need 100k's of dice rolls...But 600 is pretty small amount. Expecting it to be exactly 100 of each is pretty silly.

And less than 1% events happen periodically anyway. You are acting like less than 1%=impossible.


I'm not expecting it to be exactly 100, but you do get that that is the basis for the math involved right? In a perfect world where everything is perfectly random that is what you would expect. 100 is used purely as a base for comparison.

What I've seen so far is that if you run multiple separate batches you find similar occurrences. I've run the GW red twice (10x30 for a total of 300), for example with Chi-Square results of 3.42% and 0.27%. These dice consistently produce results that are far away from statistical random. In addition they always favor the 3 side. 1% is possible, but what are the odds that batch rolls roll under 4% twice? These dice have a bias.

Take the Chessex Orange/ transparent results for example, in a similar study as above they generated Chi-Square results of 87.61% and 79.15%. They are considerably closer to random than the GW red and that's the comparison I'm trying to make.


Automatically Appended Next Post:
Below is a combination of the batch rolls previously posted including casino dice. The casino dice were rolled as 5 dice x 120 rolls instead of the 10 dice x 60 like the other dice (only half my casino dice order arrived)

I agree that the more data the better and I plan to periodically add to these when bored.

This message was edited 1 time. Last update was at 2019/03/04 20:54:18


DA KRIMSON KLAWZ
 
   
Made in gb
Fresh-Faced New User




Say what you like but I've done this sort of testing many times with many different dice. When the Mrs asks it's to "find the dice with the best results" (she's a mathematician and it really winds her up) but in actual fact rollign dice is therapeutic.

I've plenty of friends who are statisicans / mathematicians and though they've never seriously sad me down to explain how many times I should roll the dice the "over a pint" comment is 1,000 is a "good number".

My experience has shown me:

1) Smaller GW dice give results biased towards 1-3.
2) Chessex & casino dice have given me results broadly inline with expected results.
3) No set of dice I've ever rolled have given me the expected number (or above) for 6 after 1k rolls.

And not based on testing ;-)

4) Anyone who uses smaller GW dice in a game will get the impression the dice are rubbish and will blame them for losing.
5) Anyone I tell I want to use my "lucky" dice will insist on using those same dice the rest of the game.
6) My opponent will rage and curse my dice/luck when I make more than 3 6++ saves in a roll (that's not rolling 3d6 at once, but 3 separate saves).

In all seriousness... I personally don't use GW dice anymore ;-) and I'm having my own custom set made up .

This message was edited 2 times. Last update was at 2019/03/08 14:33:16


 
   
 
Forum Index » Dakka Discussions
Go to: