Sort wrongly removing rows

adolf garlic


I have a sort component which is (wrongly) reducing the number of rows* in my dataset.

NB "remove duplicates" is NOT ticked!

Why is this occuring


*number displayed on the flow arrows at runtime

adolf garlic


I should add that it was originally ticked, but I no longer require this functionality.

DarrenSQLIS

Was there a problem or not Can someone else learn from your experience, or shall I remove the thread

adolf garlic

I would say the fact that the sort component is physically removing rows from the data is a bug, never mind a problem.

Still, MS aren't going to do anything about it.

I haven't got time to figure out test scenarios for what causes it.

I'm certainly not going to waste time attempting to enter it into the world's worst website aka Connect

So....

print it out, make a paper hat etc

Phil Brammer

adolf garlic wrote:

I would say the fact that the sort component is physically removing rows from the data is a bug, never mind a problem. Still, MS aren't going to do anything about it.

I've never had the sort component remove rows.

So if you've found a bug with reproducible steps, please log into Connect and post it.

adolf garlic wrote:

I'm certainly not going to waste time attempting to enter it into the world's worst website aka Connect

Then why do you waste our time here on this Web site It's no better than Connect, now isn't it

Please help us in the community and within Microsoft to help improve the product.

adolf garlic

Connect:
time to enter problem: ages
possibility of solution: probably never, maybe in the next release if you are lucky



forum:
time to enter problem: minutes
possibility of solution: >50%


I've fed back into connect and they don't listen. Waste of time. I've even fed back to connect about connect!

I see the forums as getting round problems MS can't be bothered to solve.

I'm more than willing to help others on forums when I can. SSIS isn't my usual domain hence asking questions rather than answering them.

If I google and no results come up, if I have no colleagues with particular expertise in the subject, if the books I have show no answers, what do you propose I do

Phil Brammer

adolf garlic wrote:

Connect: time to enter problem: ages possibility of solution: probably never, maybe in the next release if you are lucky

It takes 30 seconds to enter a problem!!

adolf garlic

no way

this must be a different site to the one i'm using

i'm going to document it

marks set...GO!

google on 'microsoft connect'
click on 1st link
click sign in
takes 10 seconds to load - has already recognized passport sign in

hmm..but where is the 'raise a bug link'

try 'my participation' link
nope
click connect home
click connect introduction
nope
where is the link
connect home
click available connections
nope
this is stupid
click home
click top rated feedback dropdown 'sql server' (surely can't be here - i want to raise a bug, not look at a top 10)
hmm still nothing
maybe i should go home..

click "more..."
20 seconds while the page loads
A-HA! the webpage bug raisy thing
now it's asking me to search
try "ssis sort"
takes 28 seconds to load
nothing relevant shows up, can't be an existing bug
click 'submit feedback'
takes 13 seconds to load
click bug form
takes 12 seconds to load

yikes, there are 13 things to fill in - way more than forums
ok done (albeit crappily because my life force is now very low)
still got to rate it - 5 stars of course!
ok , started at 1714, time now 1730

even assuming for stopping to enter text in this window that is waaaaaaaaaaaaaaaaaaaaaaaaaaay too long, painful horrible process, and that's why i no longer bother

where you get 30 seconds from is beyond me, i had to wait longer than that for page loads

Phil Brammer

Go!

http://connect.microsoft.com/sqlserver/feedback

Wait three seconds for page load.
Click on "Submit Feedback"
Search for existing submissions - 2 seconds
None comes up, click on "Submit Feedback"
Click on SQL Server Bug Form
Start filling out form

Less than 30 seconds, depending on how fast you type

From this page, just hit Submit at the bottom and you're done. Easy.

Rafael Salas

But before going that far and submitting a bug form;

How are you sure is the sort transform the one removing rows did you watch the number of rows coming in and out of the sort which other transformations doe the package have

Phil Brammer

Rafael Salas wrote:

But before going that far and submitting a bug form;

He already did: https://connect.microsoft.com/SQLServer/feedback/ViewFeedback.aspx FeedbackID=291510

Rafael Salas

Hum! I was not able to reproduce that issue...

jwelch

Seeing that he had remove duplicates checked at one point, and then unchecked it, I wonder if the change just didn't take. I haven't run into that myself, though.

dcb99

All,

I am seeing the same problem. Essentially I have an OLE DB Source connected to a SQL 2000 database. The transformation makes its way through two lookups and then a merge. When the pipeline leaves the Merge I am seeing 3376 rows. Despite the fact that I have _never_ checked the Remove rows with duplicate sort values checkbox, on the other side of the sort I am seeing 634 rows output. So, input into the Sort are 3376 rows, and 634 are output.

Of course this is a critical problem, since in my case there is no other way to use the merge that comes after the sort. So, I will literally have to completely re-write this transformation. So, what are my chances of getting a hotfix for this problem Should I try to open up a support incident In the mean time I have voted on the Connect issue submitted above. To me this is a huge bug, and should not wait for another release. That's my 2 cents.

Thanks.

dcb99

jwelch

Can you try opening the package in the code view (or directly in notepad) and searching for "EliminateDuplicates" You should see a proprty node like the following:

Code Block

<property id="130" name="EliminateDuplicates" dataType="System.Boolean" state="default" isArray="false" description="Indicates whether the Sort transformation removes rows with duplicate sort values." typeConverter="" UITypeEditor="" containsID="false" expressionType="None">true</property>

What's the value inside the tags (the bolded value above)