What's the worst mistake you ever made as an IT pro?
This is page 3 of the discussion. Read the opening post
After Hours
This is page 3 of the discussion. Read the opening post
by old aussie
by chaz chance#
I reported a manager when I discovered a huge cache of porn on his hard drive.
I was tracking down the source of a virus that our firewall should have stopped. I found out this guy had downloaded one of those self-install dial-ups that connect through a premium rate number, which was costing the company a fortune.
On another occasion I might have just have had a quite word with the guy. However, when I was called out to support his computer, he ranted about how lousy the tech support was and how none of us knew our job.
I took the information to the HR department. 30 minutes later I was in a meeting with my line manager and the manager that I had reported, being told to retract or my actions would be the worst thing I had ever done in my career.
I refused.
The manager was dismissed and the CEO sent an email throughout the company reminding everyone that this behaviour was strictly against policy. I received a letter commending my actions for "maintaining the highest company standards". Rumours circulated that after the manager had gone several scams that he had been involved in came to light.
Several female colleages approached me to say what a relief it was that the guy had gone. It apears that they had attempted to report his "inappropriate behaviour" on several occasions.
One month later I was formally disciplined over time-keeping. I had been late once, a rare occasion, but my line manager claimed that he had verbally warned me about it several times.
Three weeks later I was given a final warning for poor performance, and six weeks after that I was fired.
An industrial tribunal found that I was unfairly dismissed, and the compensation paid for some intensive courses. Now I am a programmer, earning 30% more, and my tech support background opens doors that wouldn't be available otherwise.
I confess that I reported the porn out of resentment for his attitude, not out of a sense of moral duty. I am not proud of what I did, because I did it for the wrong reasons. I lost a job that I was happy with, with a good company where I had lots of friends, and money can't replace that.
But what happened was a wake-up call in many ways.
First, tech support is a job, and now I have a career. My daughter (almost four months old) will have better schooling and better chances than I had.
Second, people like that manager are not nice. They will "like" you as long as you support their actions and attitudes, and dump on you when it suits them. Every time I turned a blind eye, had a quite word instead of reporting them, I became complicit in their actions. Never again. Seeing how releived some of my colleagues were when this guy was sacked has opened my eyes to just how serious these things can get.
So, I have lost my happy ignorance, and my complacent but contented "just doing the day-to-day job".
I have gained is a new awareness of the world, and my place within it. I have a list of courses, both academic and to develop myself as a person, that appears to be ever-growing. I am no longer happy with where I am in the corporate tree, seeking the position that really fulfills my potential, provides true satisfaction. And I now know that I have to make up for my previous uncaring moral attitudes, if only for my own peace of mind. I am a better man now, but it is hard work.
Sometimes, when I look at what I have ahead, I wish I could turn the clock back, unlearn those lessons.
by pompchas1
Well, this wasn't when I as a full fledged Telecom Tech but it was a big "Oh shirt"
When I was going to school for Electronics, learning or gates, nor gates, and gates and nand gates, Bolangela Alegbra and all sort of thing I'd never use in my livilihood. I got a summer job working at at computerized radio station.
What is a computedized radio station? Well. its a radio station that works off tape drives and a computer program that activated the tape drives to start when a beep code was feed to the computer from the preceeding tape drive. Pretty simple once you understand it. One of the tapes was a dis jockey's voice that introducted songs, gave generalized info of the weather and time of day. All that was recorded at the station was the commericals. My jobs was to change tapes and and time id's when they reached a certain point in the program. I could also program the computer to signal different tape sources to activate out of sequences.
Here's the blunder, this was a "Top 40" format and I had a tape that was more of "Howling Wolf" format, I think the song was "Red Rooster". I setup the tape to play over the air but when I re-recorded so it would fit in a tape drive that played over the air, I unknowingly used the power gauge as the volunme gauge.
I want it to be load so I cranked it up to +10-15 DB!! Well as soon as that tape was signled that "Howling Wolf" ran up the wire to the transmitter on the mountain top and fried the front end of that reciever to a cripy golden brown. We were off the air in a nanosecond.
I blame mother nature lighting strike of course and got away with it. If your out ther mother forgive me!!
But it was weighing heavy on my conscience ever since. I won't say what the stations name was or what part of the country this happen in but want to thank you for allowing me to vent my guilt on "Tech Repuublic"..
Regards,
Power Howling Wolf
by miltuckydave
by lori.obrien
by bg6638
by liquidxit2
by ke_gordon
This one wasn't my fault, but back in the PDP11 days I was installing a system at a electrical contracting company. They did their own wiring. I always checked the outlet voltage before I plugged a system in. I had just told my co-worker not to plug in the system until I got back with a meter. I had just walked out of the room when I heard a sound like a gun going off followed by the lights blinking. Turns out the electrician wired the 110 outlet for 220. Not only did it trip the breaker but it destroyed the surge suppressors in the rack power distribution unit. It is a good thing I had a habit of disconnecting the system components from the PDU. Needless to say the owner of the company was a little upset about the $500 bill for a new PDU. Don't know what happened to the electrician. But, I kept my eye on my coworker after that.
My biggest oops was when I was fixing a disk drive on a Cray. Put in a new power supply and forgot to check the voltage switch. It was set to 220 instead of 110. Back in those days the power supplies were not auto sensing. Fired it up and snap say goodbye to a $2000 power supply. The good thing was that my district manager came from a field service background. His response was "Well when you work in the field long enough you are bound to blow something up." Have to love it when you have an understanding boss.
by ke_gordon
by ken.hor
I always loss control to my temper and start jumping on the Vendors & Users, when ever they repeating their mistakes.
I realize that my actions actually never help me to solve the problem?
Again I have to sweet talk with them and ask them to be more alert?
And again, the mistakes keep on repeating?
And again, I loss control...
by joevano
by marionuke
by ornelyz
what about this:
grep "something" > /dev/hda1
by jimgiblin
About a dozen years ago I was working in a large mainframe shop that had a two large 80 gallon HALON tank system to protect the computer room in the event of fire. Every night we had a break of about 2 hours where there was literally nothing to do, so to pass the time, my partner and I got into an escalating rubber band fight and we were looking for larger and more powerful rubber bands to fire at one another. We ended up settling on these foot long bands that could easily sail across a 45 foot room and hit you with enough impact to leave a nice red mark. When hit up close, these things would leave welts and bruises.
One night, I was leaving the computer room to go get a soda, and my partner attempted to fire one of the rubber bands at me from a distance of like 10 feet while I was walking away from him. He missed me and accidently hit the unprotected HALON release button.
After the alarm sounded, and everything shut down, and the 160 gallons of Halon were dumped into our glass enclosed area, it was extremely quiet after we returned to the room. Every report and unbound document was blown everywhere, and we printed about 4000 pages every night. It cost the company upwards of $10k to get everything back up and running, and get the tanks refilled.
The funny thing was that after we got everything cleaned up and back online, the first thing that they did after we refilled the HALON tanks was to requisition a $40 plastic cover to be installed over the release button.
On the day that they were mounting the cover, they maintenance guy drilled right into the two wires and shorted the system, triggering another HALON dump. Suffice to say, they took our rubber bands away.
by tpgames
by delphidoc
hardware- I wanted to make an expansion card with fans on it to plug into an ISA slot on an old computer with a VLB bus. Using a voltmeter I found out the ISA slot had a positive voltage pin adjacent to a ground pin. Killed everything on the system except for the SIMMs and the hard drive.
software- made the Power Users group part of the Administrators group. Try logging on locally like that. All you have to do to fix the problem is to reinstall the server. I tried all the remedies I found on the internet without success.
by beldenm
Had been working an intermittent issue with a remote branch's T1 - it was flapping all day long, so I had telnetted to the thing to look at interface stats and kept it open and was checking every once in a while to see if it was up or down.
While I waited, I was consoled into another router on my desk, configuring it to go to another branch that was opening in a couple weeks.
Well, when you have 2 xterm windows open it's pretty easy to type into the wrong one. I assigned future IP for the router on my desk to the one at the remote office. Bye-bye remote office. Fortunately they considered it a part of the intermittent issue and I called and told them I was doing some troubleshooting with SBC and asked the local (non-technical) staff to power cycle the router - nothing was saved to NVRAM so all came back up and I told no one of my stupidity.
by jon
by merah678
Many years ago, I heard this tale of woe...
Back in the days of the big mainframe (like the one the fellow melted the core on), there was this switch on the front labeled "Emergency Pull". It was intended to be used IF and when someone was ether being electrocuted or physically "hung up" on a moving part of the machine. What it did was drop all power to everything IMMEDIATELY. Nothing graceful at all.
The new machine had just been installed and the CEO was being given a tour. He wondered what the switch did and before anyone could stop him, he pulled it.
After three days of work by several IBM repair guys, the machine was back functioning.
Not my mistake, but I was the one to discover it.
In the mainframe COBOL world, there is a 'STOP RUN' statement. Similar to an 'END', it terminates processing nomally. You can also code a 'STOP XXXXXXX' and 'XXXXXXX' displays on the system console - this is usually used to indicate some sort of error.
Some joker in our shop coded 'STOP THE ROMULANS HAVE ZAPPED WORKING-STORAGE' in the middle of a program. He put code to branch around it - so in theory, it would not be execute.
Some other joker, making the proverbial one-line change, made a change, compiled the program and cataloged it to the production library - all without testing. This program was in a critical nightly nightly job.
That night, the operator (me) was surprised by the strange message that printed on the console log that night:
STOP THE ROMULANS HAVE ZAPPED WORKING STORAGE.
The oncall progammer had to come in and figure out the screw-up. This was not the person who made the change.
The moral of the story is to TEST EVERY CHANGE - no matter how small.
by cmiller5400
by rtyii
I was working with good old big iron at a bank in NY in the 70's, and I had to verify the patch level of an O/S using PDZAP (any fans?) I had to use the console to verify this information. After I was done, the printer gave me a report on what I had looked at and I went back to my office.
Several months later the drive that the page-data-set was on, went casters up. The CE's were called in to repair the HDA, then after it was repaired, the operators presses the IPL button. After a few seconds, the system just stopped as it was initializing the PDS (Something real computers just doesn't do, stop) Of course I had to go in at 3am to see what the issue was, and I was not letting the CE leave without it working. Working with the problem, the CE decided to call in his boss to fix it, HE found NO TROUBLE with the drive, yet I can't IPL?? I attempted to restore a copy of an O/S many months old, and it finally worked! so I verified it was not a hardware problem, but I was NOT restoring and O/S several months old, so a call was placed to some PSR's (remember those?)that I had known. It was advised I open up an incident so they can come take a look see.. Well needless to say, I had a room rull of PSR's because after all, this was the nations LARGEST bank being affected. I swore up and down that I did NOT make ANY changes to the O/S that would cause it to fail. After 23 hours of the machine being down, I walked back to my office while the PSR's were trying to figure it out, I went through some listings and came across the output from the PDZAP.........can you guess what I found? I inadvertantly patched an area on the disk, where in the code, it was initializing the PDS! At this point in initialization, the O/S had no choice but to stop, because the O/S was not fully loaded and could not hanlde an error like this (invalid op code). I walked back into the computer room, across the raised floor and over to the head PSR, "I found the problem..." (we have all been there) they all looked at me an laughed out loud and said "At least we had the chance to all get together, it was fun, and NEVER call us again!" Now each time I had called for support, since they new me by then, I got asked the same question each time I called: "Have you changed anything?" hahaha
by itdesperado
by selasieye
by selasieye
by wavdav2000
by taher.afridi
1. Not saving a WEEK's worth of continuous data typing for my Thesis + Power cut. You can imagine the loss.
2. Telling my boss to F*** off.
by rayjeff
because of the usual funky security issues with NetBIOS being enabled on a workstation. It was a workstation I used all the time and then all of a sudden, couldn't get Net access anymore. It bugged me for the longest about it. Tried figuring out for months why. Then, some months ago (the problem started during the summer of last year) the network admin was doing some work to the workstations on the same row with that workstation, so I told her the problem. Turns out the problem was that the disabled NetBIOS setting was the problem. The DNS server has NetBIOS enabled, so of course the workstations needs the setting info from the server for Net access.
Dum-dum me should've known that anyway. Another tale of trying to be clever when you really aren't being clever *lol*.
by tpgames
by jespalmer
I was waiting for one of these! Not quite as bad, but I was troubleshooting a backup problem on one linux server, while I had a terminal open next to it of the main server that ran the backup program. You can guess what happened -- I deleted the entire backup program. Of course, we had been backing up many things, but NOT the backup program configuration.
It took me the better part of a couple of days to recreate the entire backup configuration. You better believe the first thing I did was set a backup for that config file!!!
by tpgames
Yesterday, I did this. This is the worst because I lost every single file in my account - including other people files in my account. And managed to wreck havoc against cPanel.
I used Scrapbook, a Firefox extension that got great reviews. The problem is that the extension does NOT get along with cPanel. I used it within cPanel while logged into my account. Scrapbook, instead of only coping all the pages, it dumped everything into trash. The problem is, I can't restore data by clicking on them in trash. Scrapbbok also caused a .htaccess.html file to store itself in one of my folders. I had to put in a support ticket/forum help to get the President of t35 to bale me out.
I'm sick to my stomach about this because it involved other people's files as well.
signed tpgames, a webidiot as webmaster does not currently apply.
by dspeacock
Actually Banyan....
We were putting a new IBM server on the network to replace an old Vines server. We had done up a complete (I know...it wasn't) checklist for the process, so when the contractor brought it in and gave us the checklist, we didn't check it over again. We connected it to the backbone and Banyan's Streettalk database went nuts. Seems that Wang had given the new server the same name as the one it was replacing and the network went postal. It took 36 straight hours, 5 full installs of the Vines OS and backup restores before it was back working properly.
I now triple check everything and take nothing for granted.
by pgm554
Even though Novell had a great rep as a technical vendor,I have been in situations where EVEN if you do everything by the book,
SH!T HAPPENS.
Been there done that.
I have had a lot of issues with Netware upgrades due to flakey software tools.
I did a DS upgrade that hammered one of my servers DS database.
I had done 5 or six the exact same way.
I called Novell and they said ,yeah this happens occasionally.
Gee ,thanks for the warrning!
by kaniki
This was years ago.. around 1998 i think. I once had someones PC here was formatting the drive in my computer.. well at least i thought I was. I have removable hard drive racks and there are 2 hard drives in the PC, one in each rack. I took one (the C: drive) out which should have been the first drive when rebooting from a boot disk, after all it was the master on the first ribbon, but for some unknown reason after booting off of a boot disk the 2nd drive, which was on the 2nd ribbon suddenly became the C: drive and the c: drive became the d: drive.
I never looked to check that the c: drive was the first drive and typed in to format the C: drive. after I took it out and put my regular drive back in I found that my 2nd drive, which was used for storing files and stuff, had been formatted.. Needless to say I could have kicked myself in the butt for doing it and not double checking.. I never did that again..
by kaniki
I had a friend that something like that had happened to. She knew someone that was suppost to be real good with computers and he needed a little extra money and she was having problems with her computer so she paid him to fix it. He lloked at it and told her that the hard drive was bad and she needed a new one. He even took the old one home and tried it on his computer to make sure it was bad. he still said that the drive was bad.
after this she talked to me and I asked to see the drive. Reconfigured the jumpers to the right settings and wouldnt you know it, it started right up.. I asked her what she wanted off of it. She was shocked that I got it to work, after all, the guy that she hired tried this drive in 2 computers and could not get it to work. I told her to bring her computer over and I checked it at my house. First thing I noticed was that the CDROM was not working, nor was it getting any power. Found out that the lines that were coming out of the power supply that led to the CDROM and the hard drive was glitching and not giving power at times.. replaced the power supply and she has not had a problem sense..
Needless to say that she never had him look at her computer again.
by kaniki
when I was an intern from school they sent me over to help out at an organization. when I got there things were really messed up, they had computers laying all around, most of them had things wrong with them. I found somehad fraid and/or missing wires, missing ram, passwords on CMOS, and more.
I got to one computer that did not work. I was told that the previous intern had worked on it, but it had not worked sinse then. I took a look at it and found that he for some unknown reason, took the power plug off of the motherboard and then put it back on. The problem was that the computer was one of the old AT styles and he put did put the power plugs back on, but backwards.. needless to say that it never ram again.
by kaniki
This discussion is closed to new replies.
Sort by Trending