
August 15th, 2011, 11:44 AM
#1
Random numbers in 2d array
I'm having a hard time with finding an efficient algorithm for this problem:
I have a very large 2D array filled with integers ranging from 0 to some specified maximum N.
I know need to increase the sum of all the elements by an integer amount m (possibly very large).
This m should be distrubuted around the array randomly, however maintaining that each element does not exceed N.
If there are k elements in the array, and m>k*N, then of course the array should be filled with N's.
Can you think of a smart and fast way to do this?

August 15th, 2011, 12:02 PM
#2
Re: Random numbers in 2d array
I'm thinking about filling random entry's with an amount chosen from the Poisson Distribution, but I can't tell if this is truely random distributed then.

August 15th, 2011, 02:17 PM
#3
Re: Random numbers in 2d array
Last edited by nuzzle; August 16th, 2011 at 02:02 PM.

August 16th, 2011, 02:39 AM
#4
Re: Random numbers in 2d array
Originally Posted by Juliusbk
If there are k elements in the array, and m>k*N, then of course the array should be filled with N's.
this is not clear to me, do you mean that the array should grow in size in this case ? or that the to be distributed amount should be truncated to k*N ?

August 16th, 2011, 02:00 PM
#5
Re: Random numbers in 2d array
Originally Posted by Juliusbk
This m should be distrubuted around the array randomly, however maintaining that each element does not exceed N.
You have to define "random". Say your idea of a random distribution is a Poisson process.
In my view if you (blindfolded) throw balls at an array of buckets you'll have a Poisson process and the number of balls in each bucket will end up Poisson distributed. Then instead of throwing the balls you can consider each bucket one by one and fill each with the number of balls you draw from a Poisson distribution.
So your idea of using a Poisson distribution to fill each bucket (add to an array element) seems okay to me.
But note that although the distribution will be random (according to a Poisson process) the number of balls in each bucket may not. This is because there already are a varying number of balls in each bucket before you start and there's the upper limit to how many balls a bucket can hold.
Also note that the simulation algorithm of the Poisson distribution must be fast for this approach to make a difference.

August 17th, 2011, 03:42 AM
#6
Re: Random numbers in 2d array
Okay lets see if i got this one right ...
The original array (small (4 * 4) for purpose of this example) where N(our max) = 9
Code:
K 1 2 3 4

1  1 5 2 3
2  8 3 9 4
3  4 7 8 6
4  2 9 1 5
So our array K(4,4) has 16 numbers...
now if we had to sum the values we get..
Code:
1  1 5 2 3 = 11
2  8 3 9 4 = 24
3  4 7 8 6 = 25
4  2 9 1 5 = 17
= 77
Now you want to increase the sum (77) by M (lets say 20) but every number must be with in N (9), AND the number must still appear to be random...
If this is the case there are two methods i can think of..
#1) Walk up the array adding a random value between 0 and (N  K(i,j)) while the sum of all added values are < M. This may require several passes, or may end before a single pass is complete.
#2) Randomly select a K(i,j) and if K(i,j) < N add one. do this M times..
Both methods will require additional checking for if Sum(K) + M is < K * N in which case all K(i,j) = N ....
Hope it makes sense..
Articles VB6 : Break the 2G limit  Animation 1, 2 VB.NET : 2005/8 : Moving Images , Animation 1 , 2 , 3 , User Controls
WPF Articles : 3D Animation 1 , 2 , 3
Code snips: VB6 Hex Edit, IP Chat, Copy Prot., Crop, Zoom : .NET IP Chat (V4), Adv. ContextMenus, click Hotspot, Scroll Controls
Find me in ASP.NET., VB6., VB.NET , Writing Articles, My Genealogy, Forum
All VS.NET: posts refer to VS.NET 2008 (Pro) unless otherwise stated.

August 17th, 2011, 04:38 AM
#7
Re: Random numbers in 2d array
Originally Posted by GremlinSA
If this is the case there are two methods i can think of..
#1) Walk up the array adding a random value between 0 and (N  K(i,j)) while the sum of all added values are < M. This may require several passes, or may end before a single pass is complete.
#2) Randomly select a K(i,j) and if K(i,j) < N add one. do this M times..
These methods represent two different definitions of "random".
In #2 the distribution is according to a Poisson process. You're suggesting the naive approach. It will take a lot of time when M is big. I suppose the OP has realized this and is looking for something faster and instead contemplates for each K(i,j) to add a number drawn from a Poisson distribution. If this approach will be faster than the naive will depend on the efficiency of the Poisson variate algorithm that is used.
Note that M random selections may not be enougth to distribute all M (to subtract one unit from M you must add it to a K(i,j) and that may take many tries). There are several probabilistically equivalent ways of handling the N limit.
As to #1, this method is not according to a Poisson distribution because the number you add to K(i,j) will depend on the existing value of K(i,j). I'm not saying this is bad or anything but one should be aware of the fact than M is not independenly distributed with this method. It's conditioned on K.
Last edited by nuzzle; August 17th, 2011 at 06:05 AM.

August 17th, 2011, 08:25 AM
#8
Re: Random numbers in 2d array
the Primary problem here is targeting the sum of random numbers.. Once you have a Fixed target.. You always end up having to calculate the last few digits ..
The balance beam we have here is Mathematically correct VS Speed ....
#1 is not 100% but gets the job done and relatively quickly..
#2 is mathematical, however could take a long time for a Large M..
I was thinking that there is a way to smarten this up ... (merge the two methods)
#3 ) ... Randomly select a K(i,j) and add a random value between 0 and (N  K(i,j)) Summing till we get to M ..
Articles VB6 : Break the 2G limit  Animation 1, 2 VB.NET : 2005/8 : Moving Images , Animation 1 , 2 , 3 , User Controls
WPF Articles : 3D Animation 1 , 2 , 3
Code snips: VB6 Hex Edit, IP Chat, Copy Prot., Crop, Zoom : .NET IP Chat (V4), Adv. ContextMenus, click Hotspot, Scroll Controls
Find me in ASP.NET., VB6., VB.NET , Writing Articles, My Genealogy, Forum
All VS.NET: posts refer to VS.NET 2008 (Pro) unless otherwise stated.

August 17th, 2011, 09:43 AM
#9
Re: Random numbers in 2d array
Originally Posted by GremlinSA
I was thinking that there is a way to smarten this up ... (merge the two methods)
But there is and the OP is on the right track I think (see his second post).
You can either generate array positions at random, each time incrementing the selected element by one until M increments have been done (as you do in #2). Afterwards each array position has been incremented by a number that follows a Poisson distribution.
As an alternative to the above you visit each array position once and add a number drawn from a Poisson distribution (and not from a position dependent uniform distribution as you do in #1). It will be equivalent to the above and faster (under certain circumstances).
What remains is to
 determine the intensity parameter for the Poisson process,
 make sure the algorithm terminates correctly with exactly M increments, and
 locate a fast Poisson variate algorithm.
Last edited by nuzzle; August 17th, 2011 at 09:53 AM.
Posting Permissions
 You may not post new threads
 You may not post replies
 You may not post attachments
 You may not edit your posts

Forum Rules

Click Here to Expand Forum to Full Width
OnDemand Webinars (sponsored)
